User-Agent: *
Allow: /
Disallow: *.swf*
Disallow: /pub/
Disallow: *.pdf
Disallow: *.htm
Disallow: *?*