The place of Fontager got its name from the Latin “Fontis Ager”, source of the soil, source that was already known under the roman period and it is still running from a rock in a corner of the park.

The legend attached to the castle says that Pontius Pilate has lived here. According to "Eusebe de Cesaree", a Christian historian from the third century, Pontius Pilate in disgrace was exiled to that region of France in 37 b. c. Appointed Governor of the town of Vienne, it said that he committed suicide by throwing himself from a tower in the Rhône. Some have recognised that tower to be in Vienne, others at the castle of Fontager.

The origins of the Fontager castle are very old; on place you can still find remains as old as the fifth century b. c., and certain remains of pottery are even more than 4000 years old.

The geographical location of the Chateau de Fontager along the river Rhone, natural seaway allowing population moves and exchanges throughout the ages, made Fontager a famous halt on the travellers journey.

The village of Ponsas has got its name from this famous roman, Pontius Pilate. The postulate seems likely since Fontager has been used as a halt between Valence and Vienne. This is confirmed by the discovery of ruins from an ancient roman Villa in the park.

Besides, a part of the castle is built on the ruins of the roman fortress. The walls are still in good condition in the cellar of the castle, the thickness count about 2.3 meters.

A lot of discoveries have been made around the castle and in the neighbourhoods. In 1962 during constructions works 40 graves were discovered, 20 of these were sarcophagus made of tiles closing up around the skeletons. They were clothed with normal wearing of the time and the graves contained vases and other specific inventory.

Coins were found in the mouths or in the shrouds. These discoveries have made it possible to define the date of the burials (1’st, 2’nd and 3rd century)

The remainders are established originating from the original gallo-roman settlement. The quantity of the discoveries, pieces of marble, vases, statues, and sarcophagus sculpted relief’s etc, shows that the site has housed a consequent roman settlement.

Different ages are recognisable in the architecture of the castle. The walls of the cellar are roman, the towers is estimated to the 12’Th century. The old Reception, now reception for the restaurant, and the salons were originally the chapel of the castle. The vaults are gothic, and probably from 13'Th century, the stairs is from the 14’Th. Other parts are from the 17’Th and 18’Th and other are of more recent construction.

Of the more recent discoveries, one has drawn especially attention. The memories of Monsieur de Vaucance tells his wife, born Madeleine de Gruel and her granddaughter born on November 9, 1584) caught by the plague died both after 8 days of suffering on a Sunday of august 1586 at noon and were buried in front of the barn, under a wooden cross. Excavations made it possible to discover the two skeletons.

Among the most famous guests at the castle is Diane de Poitiers, mistress of the French King, born in St. Vallier in 1499, living at the castle of St. Vallier. The story tells that she came riding on horseback to visit her cousins de Vaucance, living at chateau de Fontager.

Through the centuries the valley of the Rhône, and among others Fontager, was devastated by invasions of all kind, such as the Vandals, the Goths, the Lombard’s and others like the Sarrasin’s (Arabs), from which the near village of Sarras has got its name.

During the 11’th century the castle was rebuilt on the ruins of the roman villa, as described in books from the 12’th century.

A great number of famous people lived at the castle through the centuries: