It was housed in the former Haslett Warehouse, now known as 66 Franklin, which was originally constructed in 1926 for the Lawrence Company.
Around 1961 it became home to the Mikado restaurant on the ground floor, and a special glass elevator took guests up to the Castaway which opened in 1962-63, a Polynesian-theme restaurant in a new penthouse that was constructed on the roof.
Later the Castaway venue became home to the Old Spaghetti Factory restaurant.
The Warehouse was again remodeled in 2006 to restore the appearance closer to the original design. It is now home to Forge Pizza and other restaurants on the ground floor.
This Castaway location had a sister restaurant at The Castaway - San Mateo - at Coyote Point Recreation Area.