Researched and written by Donna Leight, 2025

From Peyton/Clark to Baker

In 1837, Reverend Joseph Baker bought a portion of Outlot 49 from William L. Clark and Louisa Peyton Clark, daughter of John Peyton and granddaughter of Robert Rutherford.1 The property was on the northwest corner of what is now Loudoun and Peyton Streets. On the southern portion of the property, Baker built a large two-story brick building and established a Baptist school he called the Winchester Female Academy. On the northern portion, he built a home by the Fort Loudoun well, at what is now 419 N. Loudoun Street.

In January 1855, Joseph and his wife Catharine sold the school property to Mary Ann Casey, who had been a teacher in the school. The school would change hands many times over the decades, becoming an Episcopal Seminary (the Dunbar Institute), a “classical school,” a Methodist center (the Valley Female College), and the Fort Loudoun Female Seminary.

In October 1855, the Bakers moved to Caroline County, Virginia, to start a new seminary. But Joseph died unexpectedly that December, leaving Catharine and their teenage boys to manage multiple properties without him.

There is evidence that Dr James R. Graham, pastor of the Kent Street Presbyterian Church lived in the house which served as a parsonage from 1853-1855. It was also rented to Vincent Barnes around this time.2 Barnes was the Recording Secretary and Librarian for the Young Men’s Christian Association for Frederick County. He was also the Sergeant for the Corporation of Winchester, part of the Winchester judicial system.3

In late 1859, Catharine sold their home on Fort Hill to Methodist preacher Norval Wilson and his wife Cornelia.

Who Were Joseph and Catharine Baker?

Rev. Joseph Baker (1799-1855) was a Baptist minister. We don’t know much about his family or background other than his maternal grandfather, Bowles Alder, was a farmer/planter in Charles County Maryland.

“Charles County Land Records, Bill of Sale. I, Bowles Allder of CC, planter, for 2400 lbs of crop tobacco, I have sold to James Muncaster (Munkister), 2 bay mares, 1 young sorrel horse, I horse colt, and 1 red cow, and a red and white heifer, 1 brindle heifer, and 1 bed and furniture. Signed Dec 30, 1779” 4

Catharine Todd Baker (1803-1870) was from Caroline Virginia. Her father, George Thompton Todd served in the 9th Regiment of the  Virginia Militia, commanded by Lieutenant Colonel William Boyd, during the War of 1812. Her Scottish paternal grandfather Capt. Charles Todd, served in Virginia’s 6th Regiment during the American Revolution.

Rev. Baker was the pastor at the Ketoctin Baptist Church in Purcellville Virginia from 1824 until at least 1826. His bible is on display there. In 1834, he was instrumental in securing the Old Stone Presbyterian church on Piccadilly Street for the use of the Baptist Church, with a “lease to extend said uses for 500 years.”5

Some time after 1837, he built the Winchester Female Academy on his portion of old Outlot 49. Instructions were given in Latin, Greek, French, botany, chemistry, geometry, mental philosophy, drawing, painting, and music. Tuition for English studies cost $10.50 and classical studies cost $14.50. Board and lodging for five months was $75 in 1838.6

A newspaper notice of the period described the academy grounds as “extensive and ornamented with beautiful trees, shrubbery, and flowers; the buildings are commodious with fine equipment for a girls’ school.” 7

An 1848 leaflet stated, “It always has and ever will / Be an established rule, / That on the top of old Fort Hill / Is taught the finest school.8

In 1848 , Rev. Baker wrote a long letter offering advice to one of his pupils, at their request. From this excerpt, one can surmise the expectations, teachings, and tone of the school and its environment:

“In the first place… she ought to learn self-government… in every respect; she should have complete control over herself. The tongue, the ears, the eyes, the feet, the hands, the will the passions, the tastes, as to likings and dislikings, must all be taught the rules of obedience, and should be the servant and not the mistress of every young lady wishing to fill with dignity the station allotted her. A capricious, whimsical, and petulant girl, is not only unhappy in herself, but she will likewise make her associates and companions unhappy; and prove a disgusting spectacle to all with whom she may have the slightest acquaintance… She should not yield to depression of spirits, nor should she indulge in excess of levity, mirth or laughter, but with equanimity of feeling, ever wear upon her brow the smile of cheerfulness, peace, contentment, and happiness… In your reading, be careful that the books you read be of an instructive and moral character. Abstain from novel reading – it will vitiate your taste and corrupt your principles…” 9

The old Fort Loudoun site, owned by the Bakers, was still a place of interest for visitors to Winchester in 1847, as noted in the Winchester Republican newspaper when politician Henry Clay, “the Great Compromiser” came to town.10

The Frederick County Virginia 1850 census shows Joseph, a Baptist Clergyman, Catharine, and sons Cecil & Eugene living at their Baptist Boarding House. Their youngest son Scott had died in 1846. Also on the census were 21 female students aged 9-18, a 26-year-old teacher named William W. Jones and two other women, Nancy Beans and Mary A. Baker (Casey), both age 26. Mary Ann Casey would later buy the school property.

The “Slave Schedule” for the same census shows that a Joseph Baker owned eight enslaved people, two adult females and six children. The 26-year-old woman and a 12-year-old boy were shown as “M” for mulatto, reflecting white ancestry. The others were designated as “B” for black. Names were not documented for the enslaved and their stories are very hard to recover. Another Joseph Baker, a farmer, is thought to have lived in Frederick County at that time. This author could not determine which Joseph Baker the Slave Schedule refers to.

In October 1855, the Bakers purchased the 300-acre farm “Villeboro”, in Caroline County Virginia and established a female seminary there. He accepted a position to lead the Baptist congregation of Mt. Carmel, in the neighborhood of his new home near Bowling Green Virginia. But within months, Rev. Baker died unexpectedly. His body was returned to Winchester, and he was buried at Mt Hebron cemetery, where he had given the benediction at the cemetery’s dedication ceremony in 1844.11

Following Joseph Baker’s death, there was a suit in the Chancery Court regarding his estate. Catherine had sold their home at 419 N. Loudoun Street in December 1859. Court depositions were taken in 1860. The Chancery Court online records (Index #1860-033) tell us a little about Joseph Baker and the property.

4th Question: “State if you can, what property, real and personal was left by the late Joseph Baker.” Answer: “His personally, including his slave, might be very safely estimated at $10,000, his Real estate consisting of a house and lot in Winchester in Fort Hill, opposite the residence of P.P. Dandridge. It is a brick house, plain and two story. It has a wing with a kitchen in it, also smoke house of brick and a frame carriage house and stable together under the same roof. This is all in an enclosed lot of about half an acre.”

The 1860 census found Catharine and the boys living at Villeboro. Eugene, now 21, was a farmer with a wife, Anna, and 6-month-old son Joseph. Catharine and brother Cecil were living with them on the farm. By 1870, they had purchased a farm and moved to Jefferson County, West Virginia. Cecil was no longer with them, having died in the Civil War. Eugene and Anna had another boy. Also living on the farm was a white farm laborer named Turner Jacob, a domestic servant names Agnes, and four black children.

Catharine died in 1870. She was returned to Winchester and buried at Mount Hebron Cemetery, next to Joseph.

Joseph and Catharine Baker and their tombstones at Mt Hebron Cemetery

The Baker Children

Three sons were born to Joseph and Catharine at the Loudoun Street property. There youngest, Scott, was born in 1843 but only lived three years. He is buried with his parents at Mt Hebron Cemetery. His brothers would grow up on the Fort Hill property before moving to Caroline County with their parents at ages 15 and 17. They would both join the Confederacy when the war broke out in 1861.

Captain Eugene Baker (1838-1903)

At the age of 22, Eugene Baker enlisted into B Company, 9th Cavalry (Virginia) on May 6, 1861, shortly after the war’s start at Fort Sumter on April 12. He would serve in the Confederacy for the entire Civil War and was paroled on April 15, 1865, following Lee’s surrender at Appomattox on April 9.

“Captain Eugene Baker, a veteran of the Ninth Virginia cavalry, W. H. F. Lee’s brigade, army of Northern Virginia, and for many years high sheriff of Jefferson county, was born at Winchester, Va., in 1838. He removed with his parents to Caroline county in 1855, where in 1859 he became a member of the Caroline Light Dragoons, a company of mounted militia of which he was sergeant when it was mustered into the Confederate service. During the early part of the war period the company was on duty about eighteen months as couriers for Gen. T. H. Holmes, also in picket service on the Potomac river between Dumfries and Brooks Station. At the expiration of that time, it was assigned as Company B to the Ninth Virginia cavalry. Sergeant Baker participated in the service of his command at the battles of First Manassas, the Seven Days’ campaign before Richmond, the Maryland campaign, including the battle of Sharpsburg, and the cavalry engagement at Brandy Station. After the battle of Chancellorsville, he was appointed captain and assistant quartermaster, to succeed Capt. James Forbes, who had been killed at Chancellorsville, and in this capacity he served during the remainder of the war. Among the later engagements in which he participated was one in Charles City county, in which his brother, Cecil Baker, lieutenant of Company B, Ninth cavalry, lost his life. At the close of hostilities Captain Baker returned to Caroline county, and farmed for a season, and since then has been a resident of Jefferson county, with his home at Charlestown. He was elected high sheriff of his county in 1876, and has held the office continuously, except one term, from 1881 to 1885. This prolonged trust by the people who know him best is a sufficient commentary upon the sterling character of this worthy Confederate soldier. In 1859, Captain Baker was married in Jefferson county to Anne M. Wiltshire.” 12

He is buried in Charles Town, WV.

Lieutenant Cecil Baker (1840-1864)

Like his brother, Cecil joined the Confederacy in 1861 and was a lieutenant in the Caroline Light Dragoons, 9th Regiment Virginia Volunteer Cavalry.

“A son of Rev. Joseph Baker and Catharine Tod, he was shot through the heart during a charge near Nancis Shop in Charles City County. His brother Eugene, who served in the same company, found his body and buried it in a shallow grave. He went home and reported the death, and he and Cecil’s widow Lina returned with a wagon and brought the body back to Bowling Green.” 13

He was buried in a family cemetery there.14

According to the Richmond Daily Dispatch in July 1864,

“Lt. Cecil Baker “Fell from a bullet, which pierced his heart, whilst commanding and nobly leading his squadron in a charge upon a barricade near Salem Church, Charles City county, on the evening of the 24th day of June 1854, Lieut Cecil Baker, of the Caroline Light Dragoons, 9th regiment Virginia volunteer cavalry.

Rich as is the soil of our State with blood which coursed the veins of patriot heroes, no nobler sacrifice to liberty has been offered up than this generous and kind, affectionate and dutiful, he was loved. Exacting and rigid in the essentials of duty, impartial and firm in enforcing upon others the compliance which he rendered cheerfully himself, he held, though a junior, the entire confidence and warm respect of his men.

Full of promise was the opening of his manhood – high honor to himself, effective service to his country in her struggle for life, consolation to a widowed mother, comfort and joy to a trusting wife.

The shaft is broke, the rainbow has vanished, the manly spirit has returned to the God who gave it. Bravely had he lived, bravely has he fallen…” 15


  1. Frederick County Deed Book 66, Page 306 ↩︎
  2. Morton, Frederic. The Story of Winchester in Virginia: The Oldest Town in the Shenandoah Valley. Heritage Books, 2007. ↩︎
  3. Winchester Republican, Vol 49, Number 52, 30Dec1859 and Number 3, 14Jan1859 and Vol 50, Number 5, 3Feb1860 ↩︎
  4. Ancestry.com ↩︎
  5. Cartmell, T.K. Shenandoah Valley Pioneers and Their Descendants: A History of Frederick County, Virginia, From its Formation in 1738 to 1908. The Eddy Press Corporation, Winchester, VA 1909 ↩︎
  6. Morton, Frederic. The Story of Winchester in Virginia: The Oldest Town in the Shenandoah Valley. Heritage Books, 2007. ↩︎
  7. Winchester Republican, Number 27, 3 July 1857, Winchester Republican 3 July 1857 — Virginia Chronicle: Digital Newspaper Archive ↩︎
  8. Morton, Frederic. The Story of Winchester in Virginia: The Oldest Town in the Shenandoah Valley. Heritage  Books, 2007.  ↩︎
  9. Watchman and Observer, Volume 3, Number 47, 6 July 1848, Watchman and Observer 6 July 1848 — Virginia Chronicle:  Digital Newspaper Archive ↩︎
  10. Winchester Republican, Volume 37, Number 36, 3 September 1847, Winchester Republican 3 September 1847 — Virginia Chronicle: Digital Newspaper Archive ↩︎
  11. Winchester Republican, Volume 34, Number 27, 5 July 1844, Winchester Republican 5 July 1844 — Virginia Chronicle: Digital Newspaper Archive. ↩︎
  12. Ancestry.com ↩︎
  13. Ibid. ↩︎
  14. FindAGrave.com ↩︎
  15. Daily Dispatch, Volume 27, Number 12, 14 July 1864, Daily Dispatch 14 July 1864 — Virginia Chronicle: Digital Newspaper Archive. ↩︎