Carr was born in Yorkshire, into a family of Wesleyan Methodists. His father Joseph, the eleventh son of a farmer, rejected farming as a career and went to work for the railways, eventually becoming a station master for the North Eastern Railway. Carr was given the same Christian name as his father and the middle name Lloyd, after David Lloyd George, the Liberal prime minister. He adopted the names Jim and James in adulthood. His brother Raymond, who was also a station master, called him Lloyd.

Carr's early life was shaped by failure. He attended the village school at Carlton Miniott, Yorkshire. He failed the scholarship exam, which denied him a grammar school education, and on finishing his school career he also failed to gain admission to teacher training college. Interviewed at Goldsmiths' College, London he was asked why he wanted to be a teacher. Carr answered: "Because it leaves so much time for other pursuits." He was not accepted. Over forty years later, after his novel The Harpole Report was a critical and popular success, he was invited to give a talk at Goldsmiths'. He replied that the college once had its chance of being addressed by him.

He worked for a year as an unqualified teacher - one of the lowest of the low in English education - at South Milford Primary School, where he became involved in a local amateur football team which was startlingly successful that year. This experience he developed into the novel How Steeple Sinderby Wanderers Won the F.A. Cup. He then successfully applied to a teacher training college in Dudley. In 1938 he took a year out from his teaching career to work as an exchange teacher in Huron, South Dakota in the Great Plains. Much of the year was a struggle to survive in what was a strangely different culture to him; his British salary converted into dollars was pitifully inadequate to meet American costs of living. This experience gave rise to his novel The Battle of Pollocks Crossing.

At the end of his year in the USA Carr continued his journey westward and found himself travelling through the Middle East and the Mediterranean as the Second World War loomed. He arrived in France in September 1939 and reached England, where he volunteered for service in the Royal Air Force. He was trained as an RAF photographer and stationed in West Africa, later serving in Britain as an intelligence officer, an experience he translated into fiction with A Season in Sinji.

At the end of the War he married Sally (Hilda Gladys Sexton) and returned to teaching. He was appointed headmaster of Highfields Primary School in Kettering, a post he filled from 1952 to 1967 in a typically idiosyncratic way which earned the devotion of staff and pupils alike. He returned to Huron, South Dakota in 1957 to teach again on an exchange visit, when he wrote and published himself a social history of The Old Timers of Beadle County.

In 1967, having written two novels, he retired from teaching to devote himself to writing. He produced and published from his own Quince Tree Press a series of 'small books' designed to fit into a pocket: some of them selections from English poets, others brief monographs about historical events, or works of reference. In order to encourage children to read, each of the "small books" was given two prices, the lower of which applied only to children. As a result, Carr received several letters from adults in deliberately childish writing in an attempt to secure the discount.

He also carried on a single-handed campaign to preserve and restore the parish church of St Faith at Newton in the Willows, which had been vandalised and was threatened with redundancy. Carr, who appointed himself its guardian, came into conflict with the vicar of the benefice, and higher church authorities, in his attempts to save the church. The building was saved, but his crusade was also a failure in that redundancy was not averted and the building is now a scientific study centre.

In 1986 Carr was interviewed by Vogue magazine and, as a writer of dictionaries, was asked for a dictionary definition of himself. He answered: "James Lloyd Carr, a back-bedroom publisher of large maps and small books who, in old age, unexpectedly wrote six novels which, although highly thought of by a small band of literary supporters and by himself, were properly disregarded by the Literary World".

Jim Carr died of leukaemia in Northamptonshire on 26 February 1994 aged 82 years.

When Carr gave up teaching in 1967 his aim was to try to make his living by publishing small books of poetry and by designing a series of maps of English counties which were to be read and discussed, rather than to provide navigational information. These he published himself under the imprint The Quince Tree Press, The original printing plates from several of these maps were mounted on sheets of plywood and used by Carr as "stepping stones" in his garden. The garden also contained statues he had carved himself, many of which had mirrors set into the stone, set at such an angle that the sun would shine through the windows on his birthday.

Carr wrote eight short novels which contain elements of comedy and fantasy, as well as darker passages, based on his varied experiences of life as teacher, traveller, cricketer, footballer, publisher and restorer of English heritage. All eight were published by different publishers, apart from the last two, which he published under his own imprint, The Quince Tree Press. Though many of the characters and incidents, and even much of the dialogue, are drawn from life, he always takes them just a little further into the comic. He is widely regarded as a master of the novella form, and his masterpiece A Month in the Country was nominated for the Booker Prize in 1980, when it won the Guardian Fiction Prize. In 1985 he was short-listed again for the Booker Prize for The Battle of Pollocks Crossing.

Two of his novels have been filmed: A Month in the Country (1987) and A Day in Summer (1989).

Carr wrote several non-fiction works which he published at his Quince Tree Press, including a dictionary of cricketers, a dictionary of parsons, and dictionaries of English kings and queens. He also provided the text for several school textbooks published by Macmillan Publishers and Longman which were designed to develop children's English language skills.