Material Insights · Understanding the Material World

Heat, temperature and the laws of thermodynamics: The second law, entropy and why heat flows one way

All courses / Understanding Science / Module 5: Heat, temperature and the laws of thermodynamics Part 6 of 6

The second law, entropy and why heat flows one way

The first law says energy is conserved. It does not say which way things happen. A cup of tea cools in a cold room and never warms from it, although energy would be conserved either way. This part follows how Carnot, Clausius and Boltzmann found the rule that sets the direction, what entropy measures, and how the four laws bound every engine.

6.1 The second law says heat flows downhill unaided, and Carnot found what that costs every engine

Run a film of a cooling cup of tea backwards and the tea draws heat from the cool air to warm itself. The first law has no objection, yet nobody has ever seen it. Something besides energy conservation sets the direction. Rudolf Clausius built the law from 1850, and in 1854 put it plainly: heat cannot pass from a colder body to a warmer one without some other change happening as well (MacTutor). This is one form of the second law of thermodynamics.

Another form comes from engines. A ship could in principle sail by cooling the sea. By the first law, taking heat from the water and turning it all into work is allowed. Each cubic metre of sea water cooled by 1 K gives 1,025 kg x 3,990 J/kg K x 1 K = 4.1 MJ, so a 10 MW engine would need only 10 MJ/s / 4.1 MJ per m³ = about 2.4 m³ of sea per second (calculated). But no such engine has ever worked. A heat engine needs two temperatures. It takes in heat at a high temperature, turns part into work, and must pass the rest on to a colder place.

Sadi Carnot, a young French engineer, saw this in 1824, in his book on the motive power of fire. He compared an engine to a waterwheel: the wheel's power comes from water falling from a high level to a low one, and an engine's from heat falling from a hot boiler to a cold condenser. He reasoned that the best possible efficiency depends only on the two temperatures, and not on steam or air or any other working substance. He died of cholera in 1832, at 36, and his work lay ignored until 1834. In modern form the limit is 1 - Tcold / Thot, with temperatures in kelvin.

Data Worked estimate: the Carnot limit and real engines (cold side 300 K)
EngineHot sideLimit: 1 - 300 / TTypical real value
Steam at 540 °C in a power station813 K63% (calculated)about 33 to 40%; see the engineering module
Sunlight treated as heat from the Sun's 5,770 K surface5,770 K95% (calculated)a ceiling only; no collector reaches that temperature, so real solar thermal plants do far worse
Hot water at 80 °C, a small turbine353 K15% (calculated)a few per cent
Body of a person (internal 310 K, outside 293 K)310 K5.5% (calculated, cold side 293 K)muscle works at about 25%, using chemical, not heat, energy

Calculated here. The last row shows that muscle is not a heat engine: it converts chemical energy directly, so the Carnot limit does not apply. The engineering module 'Heat and thermodynamics: engines, heat pumps and their limits' works through real cycles. See also the Carnot's limit on heat engines node.

Source: Encyclopaedia Britannica, Sadi Carnot, https://www.britannica.com/biography/Sadi-Carnot-French-scientist (born 1796, died 1832; Reflections on the Motive Power of Fire, 1824; waterwheel comparison; efficiency depends only on the hottest and coldest temperatures; ignored until 1834); MacTutor History of Mathematics (University of St Andrews), Rudolf Clausius, https://mathshistory.st-andrews.ac.uk/SH/clausius_sh.pdf (1850 paper contained a version of the second law; 1854 statement that heat can never pass from a colder to a warmer body without some other change; entropy named in 1865, from Greek tropē, transformation)

6.2 Entropy measures how widely energy is spread, and total entropy rises whenever heat flows downhill

Clausius wanted one number that would show which processes can happen. He found it and in 1865 named it entropy, from the Greek tropē, transformation (MacTutor). For heat Q added to a body at temperature T, the change of entropy is Q / T, in joules per kelvin. A joule of heat counts for more entropy when it arrives at a low temperature than at a high one.

Check this with a flow of 1,000 J from a body at 400 K to one at 300 K. The hot body loses 1,000 / 400 = 2.5 J/K. The cold one gains 1,000 / 300 = 3.33 J/K. The total changes by +0.83 J/K (calculated). If the heat flowed the other way, the total would change by -0.83 J/K. The second law says the total entropy of an isolated system never decreases, which is the same as saying heat cannot of itself pass from cold to hot.

Entropy is often called disorder, fair if you picture energy spreading out. Concentrated energy, such as fuel or hot steam, has low entropy. Spread among many molecules at low temperature, as in a lukewarm river, it has high entropy and is fit for little.

Entropy can fall in one place if it rises by more somewhere else. A refrigerator lowers the entropy of its contents while its coils warm the kitchen by more. Salt crystals growing in an evaporating pan in the Rann of Kutch are far more ordered than the dissolved salt was, but the sunlight absorbed and the vapour released add much more entropy than the crystals lose. Order here is always bought with a larger spreading of energy there.

Data Worked estimate: an entropy ledger for a refrigerator
ItemWorkingResult
Heat removed from the food space at 275 K (2 °C)100 Jentropy change -100 / 275 = -0.364 J/K
Work supplied by the compressor30 J(adds to the heat dumped)
Heat given to the kitchen at 300 K (27 °C)100 + 30 = 130 Jentropy change +130 / 300 = +0.433 J/K
Net change-0.364 + 0.433+0.069 J/K (calculated), positive, so allowed
With zero work100 J out of the cold, 100 J into the warm-0.364 + 0.333 = -0.031 J/K (calculated), negative, forbidden

The numbers are illustrative and calculated here. The refrigerator needs some work, at least about 9 J here, to keep total entropy from falling. The engineering module on heat pumps gives the practical performance.

Source: Encyclopaedia Britannica, Entropy, https://www.britannica.com/science/entropy-physics (S = k ln of the number of microscopic ways a macroscopic state can be realised; all spontaneous processes are irreversible)

6.3 Boltzmann showed that entropy counts arrangements, so the second law is a law of overwhelming odds

Why should nature prefer spreading? Newton's laws and the laws of collisions are reversible. A film of two molecules colliding, run backwards, shows an allowed collision, so the one-way arrow must come from elsewhere. Ludwig Boltzmann gave the answer in the 1870s. Take a state of a gas as you would measure it: pressure, temperature, volume. Many different molecular arrangements look the same at that level. Call the number of them W. Entropy, he said, is a constant times the logarithm of W: S = k ln W. The constant k is now called the Boltzmann constant.

Nature drifts to the state with the most arrangements because it is overwhelmingly the most probable. Open a valve between a full vessel and an empty one. Each molecule can be in either half, so with N molecules the chance that they are all on one side is 1 in 2^N. For 10 molecules that is 1 in 1,024; for 100, about 1 in 1e30; for a mole, a chance with about 2 x 10^23 zeros after the decimal point (calculated). A mole of gas that doubles its volume gains entropy of N x k x ln 2 = R x ln 2 = 8.31 J/K x 0.693, about 5.8 J/K (calculated).

So the second law is statistical. In a tiny system fluctuations do happen, as Brownian jitter shows. In anything of ordinary size they are never seen. Boltzmann was fiercely opposed while some physicists still doubted atoms.

The same idea gives the arrow of time. A cup that shatters cannot reassemble, because the shattered states are vastly more numerous. The past differs from the future because the universe began with very low entropy. The Information theory node shows how Shannon borrowed the same mathematics for messages.

  • Hewitt, Lyons, Suchocki and Yeh, Conceptual Integrated Science, 2nd edition (Pearson, 2013) · ch. 6, 'Heat'
  • Encyclopaedia Britannica, Entropy · web
  • Feynman, Leighton and Sands, The Feynman Lectures on Physics, Vol. I (Caltech) · further reading only: https://www.feynmanlectures.caltech.edu/I_39.html (the kinetic theory of gases), I_44 (the laws of thermodynamics), I_45 (illustrations of thermodynamics) and I_46 (ratchet and pawl)

6.4 The four laws bound every machine and process, and they rule out two kinds of perpetual motion

Put the ideas together. The zeroth law says that equal temperature is a property that can be compared by a thermometer: two bodies each in equilibrium with a third are in equilibrium with each other. The first law says energy is conserved, with heat and work as two ways to move it. The second law says that total entropy never falls, so heat flows downhill and no engine can turn heat into work without a cold place to reject the rest. The third law says that absolute zero cannot be reached by any finite sequence of steps.

A machine that gives out more energy than it takes in, a perpetual motion machine of the first kind, breaks the first law. A machine that takes heat from a single source, such as the sea or the air, and turns all of it into work, a machine of the second kind, breaks the second. An engine more efficient than Carnot's, or a refrigerator that needs no work, breaks it too.

'Efficiency, waste heat and recovery' in Understanding Energy shows how the temperature grade of waste heat decides what can be done with it. The Second law of thermodynamics node gives the formal statements and the history.

The thread is that huge numbers of moving particles give firm laws.

Value chain The laws of thermodynamics
  • Thermodynamics
    • Zeroth law: thermal equilibrium equal temperature is transitive, so thermometers work
    • First law: energy is conserved change in internal energy = heat in + work done on the system; rules out perpetual motion of the first kind
    • Second law: entropy of an isolated system never falls heat flows hot to cold; Carnot limit; rules out perpetual motion of the second kind; gives the arrow of time
    • Third law: absolute zero cannot be reached in finitely many steps entropy of a perfect crystal approaches a minimum as temperature approaches zero
Source: Encyclopaedia Britannica, Sadi Carnot, https://www.britannica.com/biography/Sadi-Carnot-French-scientist (born 1796, died 1832; Reflections on the Motive Power of Fire, 1824; waterwheel comparison; efficiency depends only on the hottest and coldest temperatures; ignored until 1834); Encyclopaedia Britannica, Entropy, https://www.britannica.com/science/entropy-physics (S = k ln of the number of microscopic ways a macroscopic state can be realised; all spontaneous processes are irreversible); NIST, The kelvin and the Boltzmann constant, https://www.nist.gov/si-redefinition/kelvin-boltzmann-constant (k = 1.380649 x 10^-23 J/K; redefinition approved November 2018); MacTutor History of Mathematics (University of St Andrews), Rudolf Clausius, https://mathshistory.st-andrews.ac.uk/SH/clausius_sh.pdf (1850 paper contained a version of the second law; 1854 statement that heat can never pass from a colder to a warmer body without some other change; entropy named in 1865, from Greek tropē, transformation)

See it in the table

H₂O WaterNaCl SaltTea Tea

Check your understanding

1,000 J of heat flows from a body at 500 K to one at 250 K. What is the total change of entropy?

The hot body loses 1,000 / 500 = 2 J/K. The cold body gains 1,000 / 250 = 4 J/K. The net is +2 J/K, so the flow is allowed.

Carnot's central result about heat engines is that the best possible efficiency depends on:

Carnot showed that it does not matter what the working substance is. Only the hot and cold temperatures set the limit, 1 - Tcold / Thot.

According to Boltzmann, why does a gas that has spread through a vessel never gather back into one corner?

Entropy counts the number of arrangements. The all-in-one-corner arrangements are so few against the spread ones that their chance is effectively zero for large numbers of molecules.
← Part 5: How heat moves: conduction, convection and radiationMark read · Wrap-up →