Castle Rock is located half a mile from the shore and is nestled in the sweep of the bay which is formed by the pebble beach. Very few people are aware of the existence of the rock. The evidence of the Castle Rock can be seen sometimes at a very low tide, when the sea breaks above the rock. To visit the site, one can go by a boat. This can also be visible from the Knap Car Terrace.