Read The Bletchley Park Codebreakers Online
Authors: Michael Smith
Even more vital was the account of the new generation of U-boats the German Navy was building in 1945. These were of revolutionary design, since they were the first submarines with a high underwater speed. The messages gave full details of their performance. Fortunately very few of them had become fully operational by the time of the German surrender; but if we had had to deal with them at sea, it would have been very valuable to know their capability so exactly.
We occasionally had items of more general interest, when the officer in Berlin was able to pick up information which related to Germany's ability to carry on the war. During the winter of 1944â5, the Japanese Ambassador called in his military and naval attachés for a serious appraisal of this subject, and after an exchange of information and views each sent his own report to his masters in Tokyo. The naval attaché's version passed through our hands, and must have been of vital interest to the strategists directing the Allied war effort.
In order to encipher Japanese by machine it was necessary first to write the text phonetically in the roman alphabet, something no Japanese would normally do. There was an official system of romanization, called
romaji
, which differed from the more common one, as for instance in the Kenkyusha Japanese-English Dictionary which we regularly used. However, once you got used to it, this was no obstacle, any more than the special conventions adopted to help disguise the patterning of texts. The real problem lay in the technical terms, most of which were of too recent invention to appear in the dictionary. The Japanese were able to devise their own terminology by creating new compounds out of Chinese characters. Thus to describe a radar set, they came up with a new word
dempatanshingi
. This was written with five characters:
DEN
â âelectric',
HA
- âwave',
TAN
- âsearch',
SHIN
â âfind',
Gl
- âapparatus'. It was easy enough to work out the meaning of such a compound, provided you knew which the characters were. The trouble was that when written phonetically many characters had the same phonetic form, so each syllable might represent any of several characters, and in the worst cases there might be as many as twenty or thirty alternatives. For instance, DEN literally means âlightning' but can be used to mean âelectricity', and could equally well be translated as ârice-field'.
Watts and Pickles both had their own indexes of compounds they had encountered and successfully solved, and I began to build one of my own â which I still possess, having illegally retained it at the end of the war. A short selection of the English equivalents will give some idea of the kind of material we had to translate. None of these terms was in any dictionary available to us: prevention of espionage; yield (of a mechanical process); tail-plane; cordon sanitaire; superimpose; (electric) earth; warming up (of an aircraft engine); (electrical) waveguide; (in optics) pupil-diameter; silver paper; angle of incidence; synthetic oil; magnetron; gun-turret; quadrilateral; reducing solution; stall (of aircraft); cavity resonator; Order of the Rising Sun; lens tube; suicide squad; combustibility; screw cap; coal slag; directional; catapult; sensitive nose fuse; temporary disbursing officer; laminar flow; cloud height; oils and fats; Trans-Siberian railway.
The
suikan
story is worth telling, though it was not mine. Pickles spent a long time wrestling with a report describing night-vision for fighter-pilots, but he could make nothing of a word which occurred repeatedly, spelled
suikan
. We were familiar enough with
sensuikan
(âsubmarine'), but clearly this was made up of very different characters.
SUI
offered few possibilities, and almost always it meant âwater' or âliquid' as in the word for submarine. But
KAN
was one of our worst horrors, with something like thirty characters to choose from. Only after scouring local libraries was he able to find a book on anatomy, which gave an account of the microscopic structure of the retina of the eye, where he met for the first time the phrase ârods and cones', regularly used to describe it. Now one possible value for
SUI
was âcone', and among the many possible characters for
KAN
was one which meant ârod'. Once identified it was easy to write the correct characters and thus to understand the passage.
It was a great honour to have been chosen to work, even as a humble assistant, with these men, who performed an invaluable service by providing translations of such recondite material. I never heard of them again after our organization was dissolved at the end of the war, so perhaps this tribute, posthumous as it is likely to be, is an appropriate note on which to end this memoir.
The obsessive secrecy of GCHQ about the historic achievements of Britain's codebreakers, and the contrasting willingness of the US authorities to release their own material, has distorted the history of codebreaking in the first half of the twentieth century. Nowhere has this been more evident than in the British contribution to the war in the Far East. While a few books like Alan Stripp's
Codebreaker in the Far East
and the collaborative
Codebreakers
have shed light on the work carried out by the British on Japanese codes and ciphers, they have merely scraped the surface. It was not until the late 1990s that GCHQ finally began to release files on codebreaking operations in the Far East, revealing that the British had been just as successful in this field as the Americans. The work of remarkable men like John Tiltman and Hugh Foss has had to be reassessed in the light of recent releases. Tiltman in particular emerges as a man who
truly
earned his wartime title as Chief Cryptographer, making the first inroads into the super-enciphered codes adopted by the Japanese in the late 1930s, and breaking the most famous, the main naval code JN-25, within weeks of its appearance. This chapter highlights the British contribution to the codebreaking war in the Far East. It also examines the sometimes fractious relationship between the British codebreakers and the US Navy, an area in which there may be yet more revelations to come.
MS
Japan was one of the most important targets for GC&CS during the interwar years; indeed for much of that period it was second only to Bolshevik Russia. The Japanese had emerged from the First World War as the third largest naval power behind Britain and America and were determined to expand their influence in the Far East, particularly in China. But despite their arrival as a super-power the Japanese codes and ciphers were relatively unsophisticated, said Alastair Denniston, the operational head of GC&CS. The codebreakers' Japanese expert, Ernest Hobart-Hampden, a former senior official at the British embassy in Tokyo and co-editor of the leading English-Japanese dictionary, âsoon acquired an uncanny skill in never missing the important', Denniston recalled. âThroughout the period down to 1931, no big conference was held in Washington, London or Geneva in which he did not contribute all the views of the Japanese government and of their too verbose representatives.'
The first attacks on the codes and ciphers used by the Japanese armed forces were directed against the Imperial Japanese Navy. During the early 1920s, William âNobby' Clarke, one of the former members of the Admiralty's Room 40 codebreaking section, persuaded a number of Royal Navy officers to spend their spare time listening in to messages between Japanese ships and their naval bases. There were a number of inherent problems, one of which was that the Japanese Morse code consisted of many more signs than its English equivalent.
The advent of the telegraph had brought problems for the Japanese, whose written language was based on pictorial characters or ideographs, called
kanji
, and around seventy phonetic symbols called
kana
. The sound of words containing
kanji
can be represented using
kana
. But Japanese has a large number of different words which, while having distinctive written forms, sound the same. So a
system of transliteration known as
romaji
developed which allowed the
kana
syllables to be spelled out in Roman letters. The Japanese created their own Morse code, which contained all the
kana
syllables plus the
romaji
letters and was totally different from the standard international system.
Paymaster Lieutenant-Commander Harry Shaw, a Royal Navy officer who had just completed a Japanese interpretership at the British embassy in Tokyo was sent to GC&CS to assist Hobart-Hampden. But more Japanese experts were needed and the Royal Navy decided to try to poach a Royal Australian Navy officer who had achieved amazing results on his own interpretership course. Paymaster Lieutenant Eric Nave was now serving on board HMAS
Sydney
, the RAN's flagship, where he had set up his own operation to intercept Japanese messages.
The RAN agreed to lend Nave to the British and he was posted to HMS
Hawkins
, the flagship of the Commander-in-Chief, China Squadron, to act as a Japanese interpreter. He arrived at the British naval base in Shanghai in July 1925 and eventually received his instructions that he was to intercept and decipher Japanese radio messages. âThe extent to which this method of obtaining intelligence can be utilized in war largely depends on a plentiful supply of naval cipher messages in peace time,' the messages from the sea lords said. âUp to the present, only a small number of naval cipher messages have been received and a great many more are required. The use of a ship as a combined intercepting and deciphering centre appears to offer the best solution.'
Nave was given a trained wireless operator, Petty Officer Gordon Flintham, to intercept the messages. With the assistance of Japanese officers, who believed their language alone made the messages impenetrable, and a Japanese operator who helpfully ran through the complete Japanese Morse code in a practice message. Nave began to intercept Japanese naval messages. They soon made good headway, breaking into the
tasogare
, the basic naval reporting code used by the Japanese to announce the sailings of individual ships. All the information Nave managed to produce, together with any messages he was unable to break, was to be sent back by bag to the Admiralty in London, which passed it straight on to the codebreakers. Any further results were passed back to Nave and by the end of 1928 the Japanese Navy's Main Operational Code could be read without problems.
The early 1930s saw major improvements in the systems of codes and ciphers used by the Japanese. But the increase in traffic resulting
from the Japanese occupation of China, and an influx of more Japanese experts, allowed the British codebreakers to keep on top of the problem. There was also a marked increase in Japanese espionage against the British, particularly targeted at the naval base in Singapore and led by the Japanese naval and military attachés in the embassies around the world. The Japanese military attaché code was broken in 1933 by John Tiltman. âThere was a small basic code chart of, I think, 240 units which meant that a large part of the plain-text had to be spelled out in syllables,' he said. âI don't remember the details of the system except that the code-chart had to be reconstructed and forty different sets of lines and column coordinates recovered.'
In order to disguise the espionage, the Japanese naval attachés began using a cipher machine, but this was broken in September 1934 by Oliver Strachey, a veteran of the Army's First World War codebreaking operations, and Hugh Foss, who had learned Japanese while his father was working as a missionary in Japan. The improvised nature of the British operations at the time is perhaps best demonstrated by the Heath Robinson nature of the first attempts to replicate the Japanese machine. âThe first trial was made in the office using a brown foolscap file cover with a collar stud retrieved from a returning laundry parcel, a piece of string and slots cut in the cover for the letters,' Nave recalled. âThis worked, so we asked the Signal School at Portsmouth to help and received some expertly finished models in Bakelite.' The Japanese diplomatic codes and ciphers were translated by Hobart-Hampden, Harold Parlett and N. K. Roscoe â all of whom were former British consular officers in Japan, as well as J. K. Marsden, a former military attaché in Japan, and Captain Malcolm Kennedy, who had been seconded to the Japanese Army and had also been Reuters correspondent in Tokyo.
By now it was clear that the telegrams carrying the most sensitive information were being enciphered using a machine. The Japanese referred to this as the
angoo-ki taipu a
, the Type A cipher machine. It was very similar to the Japanese naval attaché machine broken by Foss and Strachey, although it used
romaji
letters rather than
kana
syllables. It consisted of two typewriters, one to input the plain-text, the other to type out the enciphered message, a standard telephone exchange plugboard, and the encipherment mechanism. Pressing one of the keys on the input typewriter sent an electrical impulse through the machine producing the enciphered letter on the output
typewriter. Basic cryptographic analysis of the messages enciphered on the machine, almost certainly carried out by Foss and Strachey, showed that the keys changed every ten days and that it was extremely vulnerable to attack. By November 1934, they had found a way in. Recovering the messages was likely to prove time-consuming, so the Metropolitan Police signals expert Harold Kenworthy was asked to produce a machine that would allow the codebreakers easy access to the Japanese diplomatic cipher. The âJ Machine', as it was known, was working by August 1935.
Shortly after the breaking of the Type A machine, in November 1934, Britain decided to set up its own espionage operation based in Hong Kong. The Far East Combined Bureau (FECB) was to collect intelligence from every possible source, including Sigint, and an intercept site was set up on Stonecutters Island, four miles across the harbour from the FECB offices, where there was a small team of codebreakers led by Harry Shaw. They focused on the three main Japanese Navy codes and ciphers: the Japanese Naval General Cipher, the Flag Officer Code used by naval staff officers based in China, and the
tasogare
.
There were also military officers and operators attached to the FECB and plenty of military messages arising from the continued occupation of China and frontier clashes with the Russians. Many of these had to be sent back to London where they were deciphered by Tiltman. At the end of 1937, the Japanese again improved their codes and ciphers, going over to a super-enciphered code system. The message was encoded using a four-figure group codebook and then enciphered using an additive book containing 10,000 randomly selected four-figure groups from which a series of groups was selected and then added digit by digit to the encoded message. This was carried out using the Fibonacci system in which no figures are carried over â five plus seven therefore becomes two rather than twelve. The messages were also bisected, cut into two with the second half sent first to disguise the stereotyped preambles and make it more difficult for the codebreakers to read the message. This bisected super-enciphered code was the main type of system used by the Japanese Army and Navy throughout the war. But by the late summer of 1938, Tiltman had managed to break the Japanese military system.
Concern that Japan might further improve its code and cipher systems led in 1938 to the creation of a separate section to attack
Japanese commercial systems in order to help keep track of supply convoys. The concerns soon proved justified. Within the space of six months, the main Japanese naval system changed twice. The second system, introduced on 1 June 1939, was similar to the military super-enciphered system broken by Tiltman except that it was based on five-figure groups and used a much larger codebook. It was known to the British as the Japanese Navy General Operational Code but was to become much better known by its American designation â JN-25. Remarkably, Tiltman made the first break into the system within the space of weeks.
Shortly before the outbreak of war with Germany, the FECB moved to Singapore for fear of Japanese attack, leaving a small team of codebreakers and intercept operators in Hong Kong. On the same day, GC&CS moved
en masse
to Bletchley Park. As Bletchley Park concentrated on the battle to break the German Enigma ciphers, the Japanese military and naval sections were stripped of their staff to reinforce the FECB, taking with them the JN-25 groups recovered by Tiltman. The FECB codebreaking section had around forty people working solely on JN-25 and by May 1940 they had enough of the code groups recovered to read simple messages. The largest Japanese section at GC&CS was now the diplomatic section housed in the neighbouring Elmer's School. But the amount of useful intelligence they could produce had been limited by the introduction on all the main links between Tokyo and its embassies abroad of a new Japanese cipher machine, the
angoo-ki taipu b,
the Type B machine. Like the Type A machine, it was electro-mechanical and had two typewriter keyboards. However, the encipherment systems on the Type B ran through a series of telephone stepping switches comparable to the action of the rotors used on previous cipher machines such as the Type A or the German Enigma machine. With the British machine specialists putting the main thrust of their efforts into the Enigma ciphers, Bletchley Park made no apparent effort to break the Type B machine. Fortunately, it was being attacked on the other side of the Atlantic by both the US Army and US Navy, It was broken by a team of US Army codebreakers led, not as is commonly supposed by the veteran US cryptanalyst William Friedman, but by Frank Rowlett, a bespectacled former mathematics teacher.