The Face of Climate Censorship

This is the robots.txt file from epa.gov, captured at 1430hrs EST on April 28 2018.

Take note of Who, and What Sections of the site are Dissallowed.

This prevents a Web Crawler from being able to access specific sections and files
on the site
-dcm (@dredeyedick)

#
# robots.txt
#
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google. By telling these "robots" where not to go on your site,
# you save bandwidth and server resources.
#
# This file will be ignored unless it is at the root of your host:
# Used: http://example.com/robots.txt
# Ignored: http://example.com/site/robots.txt
#
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/robotstxt.html

User-agent: *
Crawl-delay: 10
# CSS, JS, Images
Allow: /misc/*.css$
Allow: /misc/*.css?
Allow: /misc/*.js$
Allow: /misc/*.js?
Allow: /misc/*.gif
Allow: /misc/*.jpg
Allow: /misc/*.jpeg
Allow: /misc/*.png
Allow: /modules/*.css$
Allow: /modules/*.css?
Allow: /modules/*.js$
Allow: /modules/*.js?
Allow: /modules/*.gif
Allow: /modules/*.jpg
Allow: /modules/*.jpeg
Allow: /modules/*.png
Allow: /profiles/*.css$
Allow: /profiles/*.css?
Allow: /profiles/*.js$
Allow: /profiles/*.js?
Allow: /profiles/*.gif
Allow: /profiles/*.jpg
Allow: /profiles/*.jpeg
Allow: /profiles/*.png
Allow: /themes/*.css$
Allow: /themes/*.css?
Allow: /themes/*.js$
Allow: /themes/*.js?
Allow: /themes/*.gif
Allow: /themes/*.jpg
Allow: /themes/*.jpeg
Allow: /themes/*.png
# Directories
Disallow: /includes/
Disallow: /misc/
Disallow: /modules/
Disallow: /profiles/
Disallow: /scripts/
Disallow: /themes/
# Files
Disallow: /CHANGELOG.txt
Disallow: /cron.php
Disallow: /INSTALL.mysql.txt
Disallow: /INSTALL.pgsql.txt
Disallow: /INSTALL.sqlite.txt
Disallow: /install.php
Disallow: /INSTALL.txt
Disallow: /LICENSE.txt
Disallow: /MAINTAINERS.txt
Disallow: /update.php
Disallow: /UPGRADE.txt
Disallow: /xmlrpc.php
# Paths (clean URLs)
Disallow: /admin/
Disallow: /comment/reply/
Disallow: /filter/tips/
Disallow: /node/add/
Disallow: /search/
Disallow: /user/register/
Disallow: /user/password/
Disallow: /user/login/
Disallow: /user/logout/
# Paths (no clean URLs)
Disallow: /?q=admin/
Disallow: /?q=comment/reply/
Disallow: /?q=filter/tips/
Disallow: /?q=node/add/
Disallow: /?q=search/
Disallow: /?q=user/password/
Disallow: /?q=user/register/
Disallow: /?q=user/login/
Disallow: /?q=user/logout/
# sitemaps.pl inserts for Fri Apr 28 20:05:01 EDT 2017 below
# Disallow non-primary aliases from old www.epa.gov
User-agent: *
Disallow: about
Disallow: adminweb/aboutepa
Disallow: adminweb/administrator
Disallow: adminweb/cfl
Disallow: bulbrecycling
Disallow: CFLcleanup
Disallow: adminweb/challenge
Disallow: adminweb/cleanboatingact
Disallow: adminweb/communities
Disallow: adminweb/digitalstrategy
Disallow: adminweb/documerica
Disallow: adminweb/ecoambassadors
Disallow: adminweb/ecoambassadors/oncampus
Disallow: adminweb/elkriverspill
Disallow: adminweb/epafiles
Disallow: adminweb/facebook
Disallow: adminweb/foursquare
Disallow: adminweb/greenversations
Disallow: blog
Disallow: adminweb/hydraulicfracture
Disallow: adminweb/itsourenvironment
Disallow: adminweb/lapse
Disallow: adminweb/moreinfo
Disallow: masinfo
Disallow: adminweb/open
Disallow: adminweb/petitions
Disallow: adminweb/plainwriting
Disallow: plainlanguage
Disallow: adminweb/productreview
Disallow: adminweb/productreview/mockups
Disallow: adminweb/productreview/stylebook
Disallow: adminweb/productreview/training
Disallow: adminweb/rsvp
Disallow: adminweb/signup
Disallow: adminweb/sixwords
Disallow: adminweb/socialmedia
Disallow: adminweb/twitter
Disallow: adminweb/womenshistorymonth
Disallow: womens-history-month
Disallow: adminweb/youtube
Disallow: aircomp2
Disallow: AirCompare
Disallow: airmarket
Disallow: AirMarket
Disallow: AIRMARKET
Disallow: AirMarkets
Disallow: AIRMARKETS
Disallow: airmarkt
Disallow: airmarkt/airtransport
Disallow: airmarkt/airtransport/CSAPR
Disallow: airmarkt/cmd
Disallow: airmarkt/programs/ipm
Disallow: airomsmo
Disallow: airprogm/oar
Disallow: airprogm/oar/care
Disallow: Care
Disallow: CARE
Disallow: airprogm/oar/mercuryrule
Disallow: camr
Disallow: CAMR
Disallow: cleanairmercuryrule
Disallow: airprogm/oar/sat
Disallow: airprogm/oar/sect812
Disallow: aljhomep
Disallow: AMD
Disallow: amdweb95
Disallow: asmdnerl
Disallow: asthma01
Disallow: boarddec
Disallow: captrade
Disallow: castnet0
Disallow: CASTNET
Disallow: children/climate
Disallow: climate4action
Disallow: childrhn
Disallow: cleanrgy/actionplan
Disallow: cleanrgy
Disallow: cleanrgy/egrid
Disallow: cleanrgy/powerprofiler
Disallow: cleanrgy/rdee
Disallow: cleanrgy/registry2
Disallow: cleanrgy/seeaction
Disallow: CHP
Disallow: combdhpp
Disallow: cookstov
Disallow: dsstox03
Disallow: DSSTox_StructureBrowser
Disallow: earlink1/espanol
Disallow: desastresnaturales
Disallow: earlink1/espanol/eventosnaturales
Disallow: EmergenciasNaturales
Disallow: Spanish
Disallow: earlink1/mercury
Disallow: hg
Disallow: earlink1/nationaldialogue
Disallow: nationaldialog
Disallow: earth1r6
Disallow: region06
Disallow: Region06
Disallow: Region6
Disallow: eimsprod
Disallow: EIMSPROD
Disallow: eimsprod/science
Disallow: science
Disallow: crisis
Disallow: Crisis
Disallow: emergenc
Disallow: Emergency
Disallow: emergenc/katrina
Disallow: Katrina
Disallow: Rita
Disallow: emergenc/naturalevents
Disallow: emergenc/naturalevents/hurricanes
Disallow: hurricane
Disallow: naturalemergencies
Disallow: NaturalEmergencies
Disallow: emergenc/naturalevents/wildfires
Disallow: wildfire
Disallow: emfjulte/aed
Disallow: emap2
Disallow: emfjulte
Disallow: emfjulte/tpmcmaia
Disallow: data
Disallow: envirofw/datafinder
Disallow: a4e
Disallow: AppsFortheEnvironment
Disallow: envirofw/developers/apps4env
Disallow: developer
Disallow: envirofw/developers
Disallow: envirofw
Disallow: envirofw/greenapps
Disallow: envirofw/html/fii/myproperty
Disallow: envirofw/myenviro
Disallow: envirofw/triexplorer/alias
Disallow: envsci11
Disallow: eogapti1
Disallow: eogapti1/ozonehealth
Disallow: epafoia1
Disallow: HPCC
Disallow: epahpcc1/ppcp
Disallow: epahrist/aapi
Disallow: epahrist/careers
Disallow: epahrist/careers/fellowships
Disallow: epahrist/careers/internships
Disallow: epahrist
Disallow: environmentalinnovation
Disallow: environmentalinnovations
Disallow: epainnov
Disallow: epainnov/erp
Disallow: epainnov/localadaptationtraining
Disallow: nationalcenterforenvironmentalinnovation
Disallow: ncei
Disallow: NCEI
Disallow: epainnov/performancetrack
Disallow: epainnov/sectors
Disallow: epaoswer/education/teens
Disallow: epaoswer/general/online
Disallow: epaoswer/hazwaste/ca
Disallow: epaoswer/hazwaste/combust
Disallow: BiennialReport
Disallow: epaoswer/hazwaste/data/biennialreport
Disallow: epaoswer/hazwaste/minimize2
Disallow: minimize
Disallow: epaoswer/hazwaste/minimize/npep
Disallow: epaoswer/hazwaste/pcbs
Disallow: pcb
Disallow: epaoswer/hazwaste/recycle/ecycling/taskforce
Disallow: e-cycling
Disallow: e-Cycling
Disallow: eCycling
Disallow: epaoswer/hazwaste/recycling/ecycling
Disallow: epaoswer/hazwaste/test
Disallow: SW-846
Disallow: CDmaterials
Disallow: epaoswer/non-hw/debris-new
Disallow: epaoswer/non-hw/green
Disallow: GreenScapes
Disallow: epaoswer/non-hw/imr
Disallow: epaoswer/non-hw/industd/ccr-rule
Disallow: epaoswer/non-hw/industd
Disallow: epaoswer/non-hw/muncpl2
Disallow: epaoswer/non-hw/muncpl/fullcost
Disallow: epaoswer/non-hw/muncpl/ghg
Disallow: epaoswer/non-hw/muncpl/paper
Disallow: epaoswer/non-hw/organics
Disallow: epaoswer/non-hw/payt
Disallow: epaoswer/non-hw/procure
Disallow: epaoswer/non-hw/recycle/jtr
Disallow: epaoswer/non-hw/recycle/recmeas
Disallow: epaoswer/non-hw/reduce/epr
Disallow: epaoswer/non-hw/reduce/wstewise/challenge/gameday
Disallow: epaoswer/non-hw/reduce/wstewise
Disallow: epaoswer/non-hw/tribal
Disallow: epaoswer/osw/conserve2
Disallow: RCC
Disallow: C2P2
Disallow: epaoswer/osw/conserve/c2p2
Disallow: epaoswer/osw/conserve/onthego
Disallow: epaoswer/osw/conserve/plugin2
Disallow: passiton
Disallow: plug-in
Disallow: cellphone2
Disallow: cellphone
Disallow: epaoswer/osw/conserve/plugin/cellphone2
Disallow: epaoswer/osw/conserve/plugin/cellphone/spanish
Disallow: epaoswer/osw/conserve/tools/iwarm
Disallow: EarthDay
Disallow: epapages/earthday
Disallow: epapages/epahome
Disallow: epapages/epahome/live
Disallow: epapages/epahome/pics
Disallow: epapages/epahome/sciencenb
Disallow: epapages/epahome/womeninscience
Disallow: epapages/stateoftheenvironment
Disallow: compost
Disallow: epawaste/conserve/composting
Disallow: epawaste/conserve/foodwaste
Disallow: foodrecovery
Disallow: epawaste/conserve/rrr
Disallow: epawaste/conserve/smm
Disallow: epawaste/conserve/smm/foodrecovery
Disallow: epawaste
Disallow: epawaste/hazard/tsd/pcbs/pubs/caulk
Disallow: osw
Disallow: solidwaste
Disallow: waste
Disallow: etopetop
Disallow: Athens
Disallow: ATHENS
Disallow: athensr
Disallow: AthensR
Disallow: extrmurl
Disallow: gbwebdev/ged
Disallow: GED
Disallow: greenbu3/greenhomes
Disallow: grnpower
Disallow: grtlakes/bns
Disallow: grtlakes/ecopage
Disallow: grtlakes/glindicators
Disallow: glnpo
Disallow: grtlakes/greenacres
Disallow: grtlakes
Disallow: grtlakes/lakeerie
Disallow: grtlakes/lakemich
Disallow: grtlakes/sediment/legacy
Disallow: grtlakes/solec
Disallow: DEARS
Disallow: heasdweb/dears
Disallow: heasdweb
Disallow: heatisland
Disallow: heatislands
Disallow: heds
Disallow: highgwp1/aluminum-pfc
Disallow: highgwp1/electricpower-sf6
Disallow: highgwp
Disallow: highgwp1/magnesium-sf6
Disallow: highgwp1/semiconductor-pfc
Disallow: iaplus01
Disallow: iaqtrib1
Disallow: idmdssc1/ders
Disallow: idmdssc1/ds
Disallow: idmdssc1/edr/production
Disallow: ETSS
Disallow: idmdssc1/etss/production
Disallow: idmdssc1/frs/production
Disallow: idmdssc1/read/production
Disallow: READ
Disallow: idmdssc1/sor/production
Disallow: idmdssc1/srs/production
Disallow: iedmold1
Disallow: iedweb00
Disallow: iedweb00/radon/pubs
Disallow: inter508
Disallow: isdcunix
Disallow: ju03ntsd/deploy
Disallow: ju03ntsd/hosting
Disallow: improvingregulation
Disallow: improvingregulations
Disallow: lawsregs/rulemaking
Disallow: lawsregs/rulemaking/retrospective
Disallow: medatwrk
Disallow: medecotx
Disallow: media002/media
Disallow: media002/multimedia
Disallow: mobile
Disallow: mrlcpage
Disallow: mxplorer
Disallow: naaujydh
Disallow: naaujydh/pages/models/hexsim
Disallow: narelweb
Disallow: nceapub1/heronet
Disallow: nceapub1
Disallow: nceawww1/caddis
Disallow: nceawww1/dioxin
Disallow: nceawww1/efh
Disallow: nceawww1/global
Disallow: nceawww1/hhra
Disallow: IRIS
Disallow: nceawww1/iris
Disallow: NCEA
Disallow: nceawww1
Disallow: nceawww1/risk
Disallow: risk_assessment
Disallow: ncepihom
Disallow: ncepi
Disallow: neengprg
Disallow: networkg
Disallow: Networkg
Disallow: nerlcwww
Disallow: EERD
Disallow: nerleerd
Disallow: nerlesd1/land-sci/ReVA
Disallow: nerlesd1
Disallow: nerlpage/bureau
Disallow: Nerl
Disallow: NERL
Disallow: nerlpage
Disallow: nerluvb1
Disallow: uv-net
Disallow: UV-NET
Disallow: UVNET
Disallow: nescweb0
Disallow: nescweb0/rsig/edm
Disallow: nescweb0/rsig
Disallow: ngispgm3/ecosystems
Disallow: ngispgm3/geospatial
Disallow: ngispgm3/nrmp
Disallow: ngispgm3/nsdi
Disallow: ACToR
Disallow: nhrlsup1/comptox/actor
Disallow: NCCT
Disallow: nhrlsup1/comptox
Disallow: NEEAR
Disallow: nhrlsup1/neear
Disallow: NHEERL
Disallow: nhrlsup1
Disallow: nhsrcsam
Disallow: nisujrgd/ncer_pubs
Disallow: nisujrgd
Disallow: nisujrgd/p3
Disallow: P3
Disallow: nisujrgd/science/endocrine
Disallow: nisujrgd/vendors
Disallow: npdespub/greeninfrastructure
Disallow: npdes
Disallow: oaintrnt
Disallow: oamrfp12
Disallow: oamsrpod/pmrcsc/rac2
Disallow: oaqps001/advance
Disallow: ozonepmadvance
Disallow: oaqps001/airdata
Disallow: oaqps001/airtrends
Disallow: oaqps001/blackcarbon
Disallow: oaqps001/collision
Disallow: oaqps001/combustion/compliance
Disallow: carbonpollutionstandard
Disallow: carbonpollutionstandards
Disallow: oaqps001/cps
Disallow: oaqps001/drycleaningrule
Disallow: oaqps001/greenheart
Disallow: oaqps001/lead/designations
Disallow: oaqps001/nitrogenoxides/designations
Disallow: NSR
Disallow: oaqps001/nsr
Disallow: oaqps001
Disallow: oaqps001/ozonepollution/designations
Disallow: glo
Disallow: groundlevelozone
Disallow: oaqps001/ozonepollution
Disallow: oaqps001/particlepollution/designations
Disallow: oaqps001/particlepollution
Disallow: particles
Disallow: PM
Disallow: oaqps001/powerplants
Disallow: oaqps001/powerplanttoxics
Disallow: oaqps001/sulfurdioxide/designations
Disallow: oaqps001/visibility
Disallow: oarmhome
Disallow: oarmweb1
Disallow: ocem
Disallow: ocempage
Disallow: Education
Disallow: ocepa111/NNEMS
Disallow: ocepa111/NNEMS/peya
Disallow: PEYA
Disallow: ocepa111/OCEPAterms
Disallow: OCEPAterms
Disallow: OCEPATERMS
Disallow: ocepa111/students
Disallow: ocfopage/budget
Disallow: cfo
Disallow: ocfopage/envirofinance
Disallow: finance
Disallow: ocfopage/financial
Disallow: ocfopage
Disallow: ocfopage/performance
Disallow: ocfopage/planandbudget
Disallow: ocirpage
Disallow: ocr
Disallow: ocrpage1
Disallow: oecaagct
Disallow: Compliance
Disallow: oecaerth/environmentaljustice
Disallow: oecaerth
Disallow: oeiinter
Disallow: OEI
Disallow: ERLN
Disallow: oemerln1
Disallow: oeocotis/echo
Disallow: oeocotis
Disallow: APAC
Disallow: oerrpage/apac
Disallow: communityinvolvementconference
Disallow: oerrpage/superfund/action/community/ciconference
Disallow: oerrpage/superfund/community/ciconference
Disallow: oerrpage/superfund
Disallow: oerrpage/superfund/programs/aml
Disallow: ogcadr01
Disallow: ogcrmo02
Disallow: ogdunix1
Disallow: ogwdw000/cupss
Disallow: ogwdw000/drink
Disallow: ogwdw000/lcrmr
Disallow: ogwdw000/lt2
Disallow: ogwdw000/nemicbr
Disallow: ogwdw000
Disallow: ogwdw
Disallow: ogwdw000/privatewells
Disallow: ogwdw000/watersecurity
Disallow: ogwdw000/wcit
Disallow: ohs
Disallow: ohsporta
Disallow: ohsporta/ohsportal
Disallow: oiamount/jius
Disallow: oia
Disallow: oiamount
Disallow: oigearth
Disallow: innovations
Disallow: opeiarchive
Disallow: or
Disallow: reinvent
Disallow: opeedweb/children
Disallow: envirohealth
Disallow: ncee
Disallow: opeedweb
Disallow: opeihome/burdenredux
Disallow: opp00001/bedbugs
Disallow: opp00001/foggers
Disallow: opp00001/insect
Disallow: opp00001/kids/hometour
Disallow: opp00001/mosquitocontrol
Disallow: opp00001
Disallow: opp00001/pestwise
Disallow: pesp
Disallow: opp00001/safepestcontrol
Disallow: oppeoee1/climatechange/kids
Disallow: oppeoee1/climatechange
Disallow: oppeoee1/climatechange/warmxyz
Disallow: WARM
Disallow: oppeoee1/ghgreporting
Disallow: globalchange
Disallow: globalwarming
Disallow: oppeoee1
Disallow: oppfead1/endanger
Disallow: oppsrrd1/reregistration/soil_fumigants/tarpcredits
Disallow: opptintr/asbestos
Disallow: opptintr/biotech
Disallow: opptintr/cdr
Disallow: ChAMP
Disallow: CHAMP
Disallow: opptintr/champ
Disallow: opptintr/chemfact
Disallow: chemrtk
Disallow: opptintr/chemrtk/hpvis
Disallow: opptintr/chemrtk
Disallow: opptintr/ems
Disallow: opptintr/epp/draftGuidelines
Disallow: opptintr/epp
Disallow: opptintr/epp/pubs/products/epeat
Disallow: opptintr/existingchemicals/chemview
Disallow: opptintr/fec
Disallow: opptintr/gcc
Disallow: opptintr/greenchemistry
Disallow: greenproducts
Disallow: opptintr/greenerproducts
Disallow: opptintr/greensports
Disallow: opptintr/iur
Disallow: opptintr/lead
Disallow: opptintr
Disallow: opptintr/p2home
Disallow: opptintr/p2week
Disallow: opptintr/pbt
Disallow: opptintr/ppic
Disallow: opptintr/tscacheminfo
Disallow: opptsmnt
Disallow: oppts
Disallow: orcdizux/carlabel
Disallow: orcdizux/cert/mpg
Disallow: orcdizux/diesel
Disallow: orcdizux/diesel/sector-programs
Disallow: orcdizux/emisslab
Disallow: greenvehicle
Disallow: orcdizux/greenvehicles
Disallow: oms
Disallow: OMS
Disallow: omswww
Disallow: OMSWWW
Disallow: orcdizux
Disallow: OTAQ
Disallow: orcdizux/regs/im/obd
Disallow: orcdizux/regs/ld-hwy/tier-2
Disallow: orcdizux/regs/nonroad/equip-hd
Disallow: orcdizux/regs/nonroad
Disallow: DieselRetrofit
Disallow: DieselRetrofits
Disallow: orcdizux/retrofit
Disallow: orcdizux/smartway
Disallow: smartwaylogistics
Disallow: Smartwaylogistics
Disallow: SmartwayLogistics
Disallow: smartwaymanufacturers
Disallow: Smartwaymanufacturers
Disallow: SmartwayManufacturers
Disallow: smartwayshipper
Disallow: Smartwayshipper
Disallow: SmartwayShipper
Disallow: smartwayshipping
Disallow: Smartwayshipping
Disallow: SmartwayShipping
Disallow: Smartwaytransport
Disallow: SmartwayTransport
Disallow: NHSRC
Disallow: ordnhsrc
Disallow: ordntrnt/ORD/aging
Disallow: ordntrnt/ORD/nanoscience
Disallow: NELAC
Disallow: ordntrnt/ORD/nelac
Disallow: ordntrnt/ORD/NRMRL/gwerd
Disallow: NRMRL
Disallow: ordntrnt/ORD/NRMRL
Disallow: ordntrnt/ORD/NRMRL/std/etv
Disallow: ordntrnt/ORD
Disallow: ord
Disallow: ORD
Disallow: ordntrnt/ORD/sciencematters
Disallow: ordntrnt/ORD/sciencenews/science-matters
Disallow: ordntrnt/ORD/Sustainability
Disallow: Sustainability
Disallow: orialasv
Disallow: ormisbo1
Disallow: icc
Disallow: ICC
Disallow: orsearth
Disallow: CREM
Disallow: osainter/crem
Disallow: ELAB
Disallow: osainter/elab
Disallow: osainter/fem
Disallow: osainter/hsrb
Disallow: osainter
Disallow: OSA
Disallow: osainter/raf
Disallow: osainter/raf/publications/cancer_guidelines
Disallow: osainter/spc/peerreview
Disallow: PeerReview
Disallow: osainter/stpc
Disallow: oscpmont/oscpendo
Disallow: oscpmont
Disallow: ospinter
Disallow: OSP
Disallow: ostwater/dmrtool
Disallow: guide
Disallow: ost
Disallow: OST
Disallow: ostwater
Disallow: oem
Disallow: OEM
Disallow: osweroe1
Disallow: outreach/agstar
Disallow: outreach/cmop
Disallow: outreach/gasstar
Disallow: outreach/globalmethane
Disallow: outreach/lmop
Disallow: methane
Disallow: outreach/methanetomarkets
Disallow: aieo
Disallow: Indian
Disallow: epatribal
Disallow: indian
Disallow: indiantribal
Disallow: owindian/tribal
Disallow: tp
Disallow: owmitnet/mtb/cwns
Disallow: owmitnet
Disallow: owm_keep
Disallow: OWM
Disallow: OW-OWM.html
Disallow: owmitnet/wastewatergrants
Disallow: owmitnet/water-efficiency
Disallow: WaterSense
Disallow: owmitnet/waterinfrastructure
Disallow: owowwtr1/305b
Disallow: owowwtr1/adopt
Disallow: owowwtr1/estuaries
Disallow: healthywatersheds
Disallow: owowwtr1/lakes/lakessurvey
Disallow: owowwtr1/monitoring/aquaticsurvey
Disallow: owowwtr1/monitoring/volunteer
Disallow: msbasin
Disallow: newsnotes
Disallow: nps
Disallow: NCCR
Disallow: owowwtr1/oceans/nccr
Disallow: bold
Disallow: owowwtr1/osvbold
Disallow: owow_keep
Disallow: OWOW
Disallow: owowwtr1
Disallow: owowwtr1/riverssurvey
Disallow: owowwtr1/surf
Disallow: owowwtr1/watershed/initiative
Disallow: TWG
Disallow: owowwtr1/watershed
Disallow: owowwtr1/watershed/tools/warsss
Disallow: WARSSS
Disallow: owowwtr1/watershed/trading
Disallow: Waterqualitytrading
Disallow: WaterQualityTrading
Disallow: owowwtr1/watershed/wacademy/fund
Disallow: owowwtr1/watershed/wacademy
Disallow: Watershedacademy
Disallow: WatershedAcademy
Disallow: owowwtr1/watershed/wacademy/webcasts
Disallow: owowwtr1/watershed/watershedcentral
Disallow: owowwtr1/weatherchannel
Disallow: owowwtr1/wetlands/404c
Disallow: owowwtr1/wetlands/initiative/appendixa
Disallow: owowwtr1/wetlands
Disallow: owowwtr1/wetlands/wetlandsmitigation
Disallow: wetlandmitigation
Disallow: WetlandMitigation
Disallow: Wetlandsmitigation
Disallow: WetlandsMitigation
Disallow: Wetlands
Disallow: dced
Disallow: livability
Disallow: livablecommunities
Disallow: piedpage
Disallow: projctxl
Disallow: ProjectXL
Disallow: pub0hecd
Disallow: pubinvol
Disallow: quality1
Disallow: QUALITY
Disallow: r02earth/citizenscience
Disallow: r02earth/p2/abandonedmobilehomes
Disallow: r02earth
Disallow: Region2
Disallow: r02earth/sandy
Disallow: Sandy
Disallow: r02earth/superfund/hudson
Disallow: r10earth/bristolbay
Disallow: r10earth/pugetsound
Disallow: r10earth
Disallow: Region10
Disallow: radnet00
Disallow: radon001
Disallow: records1
Disallow: reg3artd/donttopoff
Disallow: reg3hscd
Disallow: healthywaters
Disallow: reg3wapd/tmdl/ChesapeakeBay
Disallow: reg4gmpo
Disallow: reg4gmpo/surfgulf
Disallow: reg5oorc/highschool
Disallow: reg5oorc/kids
Disallow: reg5oorc/teachers
Disallow: region01/boldkids
Disallow: region01/ge
Disallow: region01/mysticriver
Disallow: ne
Disallow: NE
Disallow: region01/newbedford
Disallow: region01
Disallow: Region1
Disallow: region03/greenkit
Disallow: Leap
Disallow: region03/LEAP
Disallow: Region3
Disallow: region04/production/northbhamproject
Disallow: region04/production
Disallow: region04
Disallow: region05/air
Disallow: region05/climatechange
Disallow: region05/enbridgespill
Disallow: region05/glic
Disallow: region05/midwestcleandiesel
Disallow: region05
Disallow: Region5
Disallow: region05/superfund/brownfields
Disallow: region05/superfund/fields
Disallow: region05/superfund/oil
Disallow: R5Super
Disallow: region05/superfund
Disallow: region05/teach
Disallow: region05/water
Disallow: region09/border2020
Disallow: federalgreenchallenge
Disallow: region09/federalgreenchallenge
Disallow: region09
Disallow: Region09
Disallow: Region9
Disallow: region09/sanjoaquinvalley
Disallow: region09/sfbay-delta
Disallow: sfbay-delta
Disallow: region09/socal
Disallow: SoCal
Disallow: retail00
Disallow: rgytgrnj/cleanup/joplin_tornado
Disallow: region7
Disallow: Region7
Disallow: rgytgrnj
Disallow: rpdweb00
Disallow: rtirmd10
Disallow: sadqfzsu
Disallow: sbrefa4u
Disallow: sbrefa
Disallow: schools1/childcare
Disallow: schools1
Disallow: science1/advisorycouncilcaa
Disallow: science1/casac
Disallow: science1/sabstaff
Disallow: science1
Disallow: AVERT
Disallow: slclimat/resources/avert
Disallow: slclimat/resources/cobra
Disallow: slclimat/showcase
Disallow: slclimat
Disallow: smokefre
Disallow: Ozone
Disallow: spdpublc/partnerships/greenchill
Disallow: spdpublc/partnerships/rad
Disallow: spdpublc
Disallow: climateleadership
Disallow: stateply
Disallow: STORET
Disallow: storpubl
Disallow: sunwise1
Disallow: SunWise
Disallow: SUNWISE
Disallow: sustents/caeph
Disallow: sustents/manufacturing
Disallow: sustents
Disallow: ceppo
Disallow: swercepp/oilspill
Disallow: swerffrr
Disallow: swerosps/bf/pubs/acres
Disallow: swerosps/bf
Disallow: Landrevitalization
Disallow: LandRevitalization
Disallow: LANDREVITALIZATION
Disallow: swerosps/landrevitalization
Disallow: swerosps/webtest
Disallow: cleanup
Disallow: swerrims/cleanup
Disallow: swerrims
Disallow: swertio1
Disallow: OUST
Disallow: swerust1
Disallow: tdbnrmrl
Disallow: triinter
Disallow: TRI
Disallow: ttnatw01/nata2002
Disallow: ttnatw01/natamain
Disallow: ttnatw01
Disallow: ttnmain1/atw/nata2005
Disallow: ttnmain1
Disallow: TRIMEwebhelp
Disallow: twebhelp
Disallow: region08
Disallow: Region8
Disallow: unix0008/superfund/libby
Disallow: unix0008
Disallow: unix0008/yellowstoneriverspill
Disallow: waterspb
Disallow: agua
Disallow: watrhome/alias/iocwa40
Disallow: watrhome/alias/ioimportanceofwater
Disallow: watrhome/alias/ogwdwclimatereadyutilities
Disallow: watrhome/alias/ogwdwcommunitywaterresiliency
Disallow: watrhome/alias/ogwdwfedfunds
Disallow: watrhome/alias/ogwdwmutualaid
Disallow: watrhome/alias/ogwdwsourcewaterprotection
Disallow: watrhome/alias/ogwdwwheat
Disallow: watrhome/alias/ostwqshandbook
Disallow: watrhome/alias/ostwqslibrary
Disallow: watrhome/alias/ostwqsrepository
Disallow: watrhome/alias/owmalaskanativevillages
Disallow: watrhome/alias/owmcampusrainworks
Disallow: watrhome/alias/owmcleanwatersrf
Disallow: watrhome/alias/owmcwisa
Disallow: watrhome/alias/owmpmos
Disallow: watrhome/alias/owmsepticsmart
Disallow: watrhome/alias/owmtribalwastewater
Disallow: owmusmexicoborderwaterinfr
Disallow: watrhome/alias/owmusmexicoborderwaterinfr
Disallow: watrhome/alias/owowmywaterway
Disallow: watrhome/alias/owowrecoverypotential
Disallow: watrhome/nandppolicy
Disallow: watrhome/nutrientpollution
Disallow: ow_keep
Disallow: OW
Disallow: water
Disallow: watrhome
Disallow: webmast1/check_template
Disallow: webmast1/miketesting
Disallow: webmast1/quickedit
Disallow: webmast1/XMLSchema
Disallow: website1/NetDMR
Disallow: website1
Disallow: wtcpages
Disallow: WTC
# sitemaps for Searchable Collections
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/aboutepa.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/ambler.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/assessing-and-managing-
chemicals-under-tsca.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/beaches.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/brownfields.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/caa-permitting.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/ccr.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/children.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/clusters-program.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/cwa-404.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/dc.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/de.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/drupaltraining.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/dwregdev.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/dwreginfo.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/dwsixyearreview.xml
Sitemap:
https://www.epa.gov/sites/production/files/sitemaps/dwstandardsregulations.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/emergency-response.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/ems.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/endangered-species.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/enviro.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/environmentaljustice.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/epcra.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/ert.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/exposure-assessment-
models.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/faca.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/fedfac.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/ga.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/goldkingmine.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/grants-mining-district.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/greenchill.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/greeningepa.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/hfstudy.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/home.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/hwp.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/id.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/indoorairplus.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/ky.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/la.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/lead.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/md.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/ms.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/natural-disasters.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/nepa.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/newsreleases.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/newsroom.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/nm.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/npdes-permits.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/nutrient-policy-data.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/nutrientpollution.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/ny.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/ocir.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/ocr.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/oil-spills-prevention-and-
preparedness-regulations.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/open.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/or.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/osa.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/p2.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/pa.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/pesticide-advisory-
committees-and-regulatory-partners.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/pesticide-reevaluation.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/pesticide-registration.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/pesticide-science-and-
assessing-pesticide-risks.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/pesticides.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/pesticide-worker-
safety.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/planandbudget.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/pollinator-protection.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/publicnotices.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/quality.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/rcra.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/red-hill.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/region-9-documents.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/research.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/soil-fumigants.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/superfund.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/tmdl.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/tn.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/transforming-waste-
tool.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/tribal.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/tx.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/uic.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/ust.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/va.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/wa.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/waterdata.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/webguide.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/wetlands.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/what-you-can-do.xml
Sitemap: https://www.epa.gov/sites/production/files/sitemaps/wv.xml