TWiki
>
LCG Web
>
WLCGCommonComputingReadinessChallenges
>
WLCGOperationsWeb
>
WLCGOpsCoordination
>
HttpProxyDiscoveryTaskForce
>
HttpProxyDiscoveryProposal
(2016-02-17,
DaveDykstra
)
(raw view)
E
dit
A
ttach
P
DF
<noautolink> This is Dave's proposed standards for Http Proxy Discovery in the WLCG. See [[SquidMonitoringTFInfoSystem]] as background; from the information system's viewpoint we're talking about the "Worker Node View" here. See also the [[HttpProxyDiscoveryTaskForce#References][task force's references]]. From a grid job's perspective, here's the proposed standards: 1. If the $http_proxy environment variable is set, use it. It MAY refer to a round-robin of multiple proxies, and if so the application SHOULD try all of them if any fail. 1. Else if $PAC_URLS is set, use it as a semicolon-separated list of [[http://en.wikipedia.org/wiki/Proxy_auto-config][web Proxy Auto-Config]] (PAC) file URLs. The URLs MUST start with either file:// or http://. Try them in order and if one of them successfully returns a file, parse it and use the list of returned proxies. If it is an http:// URL, it SHOULD refer to a round-robin of at least 2 servers for reliability, and if so the application SHOULD try them all if any fail. 1. Else try reading http://wpad/wpad.dat, and if it returns a file, parse it as a PAC file. 1. Else try reading http://wlcg-wpad.cern.ch/wpad.dat and parse it as a PAC file. For an application that wants to download a file this can be easily implemented by using [[https://github.com/pacwget/pacwget][pacwget]]. If $PAC_URLS is not set then set it to "http://wpad/wpad.dat" and in any case add ";http://wlcg-wpad.cern.ch/wpad.dat". Frontier & CVMFS are both being enhanced to support these Proxy Auto-Config files, although existing sites aren't expected to convert their current configurations to use them. Here's the plan for the wlcg-wpad.cern.ch servers: 1. Look up registered squids in OIM and GOCDB. 1. For those relatively few sites that use different names (for example if they are on private networks), convert those registered squids to the "Worker Node View" through simple translation files maintained by hand on those servers by WLCG Squid operations personnel. 1. Automatically generate wpad.dat files corresponding to the GeoIP "ISP"s of the registered squids' addresses. To do this will also need to consult translation files from wlcg-squid-monitor.cern.ch that distinguish between different applications for registered squids, for the relatively few sites that distinguish. 1. Have the apache server look up a requesting IP address and return matching wpad.dat files based on GeoIP "ISP" matches with squids. 1. Enhance existing experiment-specific SUM tests from ATLAS & CMS to audit Frontier configuration information with a grid job's perspective above. 1. Add a SUM test to audit CVMFS configuration information. Large sites that support opportunistic use SHOULD have a separate set of squids strictly for opportunistic use, separate from their production squids. Large sites SHOULD also run a pair of their own wpad servers. </noautolink>
E
dit
|
A
ttach
|
Watch
|
P
rint version
|
H
istory
: r6
<
r5
<
r4
<
r3
<
r2
|
B
acklinks
|
V
iew topic
|
WYSIWYG
|
M
ore topic actions
Topic revision: r6 - 2016-02-17
-
DaveDykstra
Log In
LCG
LCG Wiki Home
LCG Web Home
Changes
Index
Search
LCG Wikis
LCG Service
Coordination
LCG Grid
Deployment
LCG
Apps Area
Public webs
Public webs
ABATBEA
ACPP
ADCgroup
AEGIS
AfricaMap
AgileInfrastructure
ALICE
AliceEbyE
AliceSPD
AliceSSD
AliceTOF
AliFemto
ALPHA
Altair
ArdaGrid
ASACUSA
AthenaFCalTBAna
Atlas
AtlasLBNL
AXIALPET
CAE
CALICE
CDS
CENF
CERNSearch
CLIC
Cloud
CloudServices
CMS
Controls
CTA
CvmFS
DB
DefaultWeb
DESgroup
DPHEP
DM-LHC
DSSGroup
EGEE
EgeePtf
ELFms
EMI
ETICS
FIOgroup
FlukaTeam
Frontier
Gaudi
GeneratorServices
GuidesInfo
HardwareLabs
HCC
HEPIX
ILCBDSColl
ILCTPC
IMWG
Inspire
IPv6
IT
ItCommTeam
ITCoord
ITdeptTechForum
ITDRP
ITGT
ITSDC
LAr
LCG
LCGAAWorkbook
Leade
LHCAccess
LHCAtHome
LHCb
LHCgas
LHCONE
LHCOPN
LinuxSupport
Main
Medipix
Messaging
MPGD
NA49
NA61
NA62
NTOF
Openlab
PDBService
Persistency
PESgroup
Plugins
PSAccess
PSBUpgrade
R2Eproject
RCTF
RD42
RFCond12
RFLowLevel
ROXIE
Sandbox
SocialActivities
SPI
SRMDev
SSM
Student
SuperComputing
Support
SwfCatalogue
TMVA
TOTEM
TWiki
UNOSAT
Virtualization
VOBox
WITCH
XTCA
Welcome Guest
Login
or
Register
Cern Search
TWiki Search
Google Search
LCG
All webs
Copyright &© 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use
Discourse
or
Send feedback