These extracts of text, telling more about Guy's Cliffe, have been taken from the web and other books:

(From web) 

In this one place in Warwickshire, events have transpired on a continuous basis since the epoch of the Saxons. Communities arrive and depart, cities are built and demolished. The unique aspect of Guy's Cliffe is that its continuous occupation is grounded in a myth of epic proportions. Sir Guy of Warwick was a hero who proved his bravery, taste for adventure, and skill on numerous occasions. Yet this gallant early knight devoted the remaining years of his life to meditation and the contemplation of the Christian faith.
This is one of the first contradictions that surround Guy's Cliffe House. It has been described as the "most beautiful abandoned Stately home in England". It exudes an unearthly atmosphere, which, as you approach only increases. It was built in and rises from the living rock of the sandstone cliff, and the edges between house, rock and foliage are indistinct. Perhaps this is why it has attracted so many painters, writers and musicians to inhabit its quarters. There is a creative and spiritual quality to Guy's Cliffe, which, once you have discovered the religious and historic aspects that are contained in this site, intensify immensely.

The site at Guy's Cliffe has been continuously inhabited since Saxon times. Sir Guy was a Saxon hero, who killed the Dun Cow close to Dunchurch, he returned from his considerable adventures to become a hermit in the caves, away from his wife who was the lady Felice of Warwick. A hermitage was founded on the site of Guy's last days, and monks inhabited the cave dwellings until the fifteenth century. The house and the mill are mentioned in the Domesday Book, the mill had reputedly already been a functioning mill for two hundred years before the Domesday census, hence, 'Saxon Mill'. In the fifteenth century the house went into the hands of the Greatheed family, who were connected to the House of Ernsby. A chapel was built next to the caves, and a statue of Sir Guy was put up in memory of the Christian hero (picture 12). Piers Gaveston, a favourite of Edward the Second (and almost certainly his lover), was sheltered near to the house, though he was discovered by the earl of Warwick, and taken to Blacklow Hill opposite, where he was beheaded (July the first 1312). The actress Sarah Siddons was another famous resident of Guy's Cliffe House, who was taken in and given a place to live for two years. Bertie Greatheed who was at the house, (1761-1832) was a travelling companion of Napoleon Bonaparte, and many of the most memorable drawings that we have today of this great dictator, were penned by Bertie Greethead. The house became a mansion when it went into the hands of the brother of the Duke of Northumberland in 1846. Much of the building work that is represented in the Victorian pictures of Guys is due to Lord Bertie-Percy. Towards the end of the nineteenth century, the chapel came to be used by a secret order of the masons, and in particular friends of the well known occultist Aleister Crowley. Masons still own the chapel which, along with one of the halls that has been restored, is in relatively good condition. The Percy family married with the Heber family, who lived in the next estate, and so extended the influence of Guy's Cliffe House in the Victorian era. The Heber-Percys lived in the house until 1945, when after several attempts to fix the roof, they decided to not repair it, and sold the contents in a grand auction. The Heber-Percys have now moved out of the area, though their memory lives on in the village of Old Milverton, and the church of St. James.

(from Reid) 

Now in ruins and providing a romantic and moving picture perched on its rock. Began in 1751 in Palladian style, and attributed to William Horn, this front is 7 bays with pediments over the end ones. It is of stone with a rusticated basement. the entrance front to the west is supposed to be an addition of 1818 but its details make it look later and John Gibson is known to have worked there in 1871. A later addition between the earlier parts is dated 1898. Inside the eighteenth century building there is a hall with handsome Rococo plasterwork. Niches flank the door at the back of the hall which has a broken pediment. The chapel of 1422 survives to the right of the Palladian front, but its front is late eighteen century. the chapel is partly hewn into the rock. This extraordinary house was built for Bertie Greatheed. Through his daughter it passed to the Percys and it was Lord Charles Bertie who commissioned John Gibson to make nineteenth century additions. 

(It should be noted that this is rather out of date and this is all that is contained in that book. Readers wishing to know more should go first to Tyack's excellent book.)