I think the Clarke short story Bill mentions is called The Sentinel, about a buried pyramid or something on the moon. I think it dates from the '50s.

Kubrick apparently looked at all of the major sci-fi films up to that time (several recommended to him by Clarke), and pretty much found them all wanting.