#################################User-agent: *## list folders robots are not allowed to index #Disallow: /members/#Disallow: /whatever/else/#Disallow: /whatever/assets/#Disallow: /audio/## list specific files robots are not allowed to index##Disallow: /directory/foo.html#Disallow: /folder2/whatever.html# ################################