Search Engine Land » Platforms » Google » Google opens the source for its robots.txt parser in Java and testing ... framework used to ensure parser results adhere to the official robots.txt ...