֦i~. j d Z g dZddlZddlZddlZddlZddlZddlZddl Zddl
Z ddl Z
ddlmZ dZdad ZdZdZ ee
j, j. Z ej2 d Zd
Zd Z d Z d
Z d Z g dZ g dZ!e!D cg c] } | jE c} Z#dKdZ$dKdZ%dddddZ& ej2 dejN Z(d Z)d Z* ej2 dejN Z+ ej2 dejX ejN z Z- ej2 dej\ ejN z Z/d Z0 ej2 dej\ ejN z Z1d Z2d Z3 ej2 d Z4 ej2 d Z5 ej2 d Z6 ej2 d! Z7d" Z8 ej2 d# Z9d$ Z:d% Z;d& Z< ej2 d'ejN Z=d( Z>d) Z?d* Z@d+ ZA ej2 d,ejN ZBd- ZCd. ZDd/ ZEd0 ZFd1ZG ej2 d2 ZHd3 ZId4 ZJd5 ZKd6 ZL G d7 d8 ZM G d9 d: ZN G d; d d? ZQ G d@ dA ZR G dB dCeS ZT G dD dEeR ZUdF ZV G dG dHeU ZW G dI dJeU ZXyc c} w )La HTTP cookie handling for web clients.
This module has (now fairly distant) origins in Gisle Aas' Perl module
HTTP::Cookies, from the libwww-perl library.
Docstrings, comments and debug strings in this code refer to the
attributes of the HTTP cookie system as cookie-attributes, to distinguish
them clearly from Python attributes.
Class diagram (note that BSDDBCookieJar and the MSIE* classes are not
distributed with the Python standard library, but are available from
http://wwwsearch.sf.net/):
CookieJar____
/ \ \
FileCookieJar \ \
/ | \ \ \
MozillaCookieJar | LWPCookieJar \ \
| | \
| ---MSIEBase | \
| / | | \
| / MSIEDBCookieJar BSDDBCookieJar
|/
MSIECookieJar
)Cookie CookieJar CookiePolicyDefaultCookiePolicy
FileCookieJar LWPCookieJar LoadErrorMozillaCookieJar N)timegmFc j t sy t sdd l}|j d at j | S )Nr
zhttp.cookiejar)debugloggerlogging getLogger)argsr s '/usr/lib64/python3.12/http/cookiejar.py_debugr , s. ""#34 << HTTPOnlyz
#HttpOnly_z #( Netscape)? HTTP Cookie FilezQa filename was not supplied (nor was the CookieJar instance initialised with one)zr# Netscape HTTP Cookie File
# http://curl.haxx.se/rfc/cookie_spec.html
# This is a generated file! Do not edit.
c dd l } dd l}dd l}| j }|j d | |j }|j
d|z d y )Nr
zhttp.cookiejar bug!
%s )
stacklevel)iowarnings tracebackStringIO print_excgetvaluewarn)r r r fmsgs r _warn_unhandled_exceptionr" B sF #"
A
a
**,C MM+c1aM@r i c | d d \ }}}}}}|t k\ rPd|cxk rdk rEn y d|cxk rdk r7n y d|cxk rdk r)n y d|cxk rdk rn y d|cxk rdk r
t | S y y ) N r
; = )
EPOCH_YEARr )ttyearmonthmdayhourminsecs r _timegmr3 Q s (*2A%D%tS#
!u"2"2 :;d b
d b !C~2~ 56NNbz 5C r )MonTueWedThuFriSatSun) JanFebMarAprMayJunJulAugSepOctNovDecc P | /t j j t j }n/t j j | t j }d|j |j
|j |j |j |j fz S )aH Return a string representing time in seconds since epoch, t.
If the function is called without an argument, it will use the current
time.
The format of the returned string is like "YYYY-MM-DD hh:mm:ssZ",
representing Universal Time (UTC, aka GMT). An example of this format is:
1994-11-24 08:49:37Z
tzz %04d-%02d-%02d %02d:%02d:%02dZ)
datetimenowUTC
fromtimestampr- r. dayr0 minutesecondtdts r time2isozrT ^ s y
"
"hll
"
3
,
,Q8<<
,
@ +
266277BIIryy/B B Br c | /t j j t j }n/t j j | t j }dt |j |j t |j dz
|j |j |j |j fz S )zReturn a string representing time in seconds since epoch, t.
If the function is called without an argument, it will use the current
time.
The format of the returned string is like this:
Wed, DD-Mon-YYYY HH:MM:SS GMT
rH z#%s, %02d-%s-%04d %02d:%02d:%02d GMTr% )
rJ rK rL rM DAYSweekdayrN MONTHSr. r- r0 rO rP rQ s r
time2netscaperY q s y
"
"hll
"
3
,
,Q8<<
,
@ 0 RZZ\BFFF288A:$6
"))RYY40 0 0r )GMTrL UTZz^([-+])?(\d\d?):?(\d\d)?$c d }| t v rd}|S t j | }|redt |j d z }|j d r |dt |j d z z }|j d dk( r| }|S )Nr
i r < r% -) UTC_ZONES TIMEZONE_REsearchintgroup)rI offsetms r offset_from_tz_stringrh s
F Y M
r " C
O+Fwwqz "s1771:"66wwqzS Mr c t | }|t j kD ry t j |j dz }|d}|d}|d}t | } t | }t | }t | }|dk r\t j t j d }|dz } |}
||z | z
}| |
z
} t | dkD r| dkD r|dz }n|dz
}t ||| ||||f } | '|d}|j }t | } | y | | z
} | S # t $ r5 t | }n# t $ r Y Y y w xY wd|cxk rdk rn Y y |}nY y Y w xY w)Nr% r& r
i d 2 rL )
rd rJ MAXYEAR MONTHS_LOWERindexlower
ValueErrortime localtimeabsr3 upperrh )
rN monyrhrr1 r2 rI imoncur_yrrg tmprR rf s
r _str2timer{ s RB H -a/
z2
{!C
{!C
c(C RB
c(C
c(C Dy ,Q/ SL
&[1_
G q6B;1u28bCx" S#r3R01A}
:B
XXZ&r* >
J H[ s8D ?? C
s; &D E' D32E3 E <E?E EEEzV^[SMTWF][a-z][a-z], (\d\d) ([JFMASOND][a-z][a-z]) (\d\d\d\d) (\d\d):(\d\d):(\d\d) GMT$z+^(?:Sun|Mon|Tue|Wed|Thu|Fri|Sat)[a-z]*,?\s*a ^
(\d\d?) # day
(?:\s+|[-\/])
(\w+) # month
(?:\s+|[-\/])
(\d+) # year
(?:
(?:\s+|:) # separator before clock
(\d\d?):(\d\d) # hour:min
(?::(\d\d))? # optional seconds
)? # optional clock
\s*
(?:
([-+]?\d{2,4}|(?![APap][Mm]\b)[A-Za-z]+) # timezone
\s*
)?
(?:
\(\w+\) # ASCII representation of timezone in parens.
\s*
)?$c . t j | }|r|j }t j |d j dz }t
|d |t
|d t
|d t
|d t |d f}t | S | j } t j d| d } dgd z \ }}}}}} }
t j | }||j \ }}}}}} }
nyt |||||| |
S )
a Returns time in seconds since epoch of time represented by a string.
Return value is an integer.
None is returned if the format of str is unrecognized, the time is outside
the representable range, or the timezone string is not recognized. If the
string contains no timezone, UTC is assumed.
The timezone in the string may be numerical (like "-0800" or "+0100") or a
string timezone (like "UTC", "GMT", "BST" or "EST"). Currently, only the
timezone strings equivalent to UTC (zero offset) are known to the function.
The function loosely parses the following formats:
Wed, 09 Feb 1994 22:23:32 GMT -- HTTP format
Tuesday, 08-Feb-94 14:15:29 GMT -- old rfc850 HTTP format
Tuesday, 08-Feb-1994 14:15:29 GMT -- broken rfc850 HTTP format
09 Feb 1994 22:23:32 GMT -- HTTP format (no weekday)
08-Feb-94 14:15:29 GMT -- rfc850 format (no weekday)
08-Feb-1994 14:15:29 GMT -- broken rfc850 format (no weekday)
The parser ignores leading and trailing whitespace. The time may be
absent.
If the year is given with only 2 digits, the function will select the
century that makes the year closest to the current date.
r% r r
r^ N )STRICT_DATE_RErc groupsrm rn ro rd floatr3 lstrip
WEEKDAY_REsubLOOSE_HTTP_DATE_REr{ ) textrg gru r, rN rv rw r1 r2 rI s r http2timer s < d#A
HHJ 1 .2!A$ic!A$i!A$iQqTE!A$K1r{
;;=D >>"dA &D '+VAX"Cb"c3 !!$'A})*&S"b#sB S#r2sC 44r a ^
(\d{4}) # year
[-\/]?
(\d\d?) # numerical month
[-\/]?
(\d\d?) # day
(?:
(?:\s+|[-:Tt]) # separator before clock
(\d\d?):?(\d\d) # hour:min
(?::?(\d\d(?:\.\d*)?))? # optional seconds (and fractional)
)? # optional clock
\s*
(?:
([-+]?\d\d?:?(:?\d\d)?
|Z|z) # timezone (Z is "zero meridian", i.e. GMT)
\s*
)?$c | j } dgdz \ }}}}}}}t j | }||j \ }}}}}}}} nyt ||||||| S )av
As for http2time, but parses the ISO 8601 formats:
1994-02-03 14:15:29 -0100 -- ISO 8601 format
1994-02-03 14:15:29 -- zone is optional
1994-02-03 -- only date
1994-02-03T14:15:29 -- Use T as separator
19940203T141529Z -- ISO 8601 compact format
19940203 -- only date
Nr )r ISO_DATE_RErc r r{ )
r rN ru rv rw r1 r2 rI rg _s
r iso2timer 2 sz ;;=D '+VAX"Cb"c3 4 A} -.HHJ)Cb#sB S#r2sC 44r c h | j d \ }}| j d| | j |d z S )z)Return unmatched part of re.Match object.r
N)spanstring)matchstartends r unmatchedr S s4 A JE3 << ST 2 22r z^\s*([^=\s;,]+)z&^\s*=\s*\"([^\"\\]*(?:\\.[^\"\\]*)*)\"z^\s*=\s*([^\s;,]*)z\\(.)c t | t rJ g }| D ]s }|}g }|rTt j | }|rt | }|j d }t j | }|r3t | }|j d }t j d| }nFt j | }|r-t | }|j d }|j }nd}|j ||f ny|j j d r)|j dd }|r|j | g }n1t j dd| \ }} | dkD sJ d|d |d
| |}|rT|sc|j | v |S ) am Parse header values into a list of lists containing key,value pairs.
The function knows how to deal with ",", ";" and "=" as well as quoted
values after "=". A list of space separated tokens are parsed as if they
were separated by ";".
If the header_values passed as argument contains multiple values, then they
are treated as if they were a single value separated by comma ",".
This means that this function is useful for parsing header fields that
follow this syntax (BNF as from the HTTP/1.1 specification, but we relax
the requirement for tokens).
headers = #header
header = (token | parameter) *( [";"] (token | parameter))
token = 1*
separators = "(" | ")" | "<" | ">" | "@"
| "," | ";" | ":" | "\" | <">
| "/" | "[" | "]" | "?" | "="
| "{" | "}" | SP | HT
quoted-string = ( <"> *(qdtext | quoted-pair ) <"> )
qdtext = >
quoted-pair = "\" CHAR
parameter = attribute "=" value
attribute = token
value = token | quoted-string
Each header is represented by a list of key/value pairs. The value for a
simple token (not part of a parameter) is None. Syntactically incorrect
headers will not necessarily be parsed as you would want.
This is easier to describe with some examples:
>>> split_header_words(['foo="bar"; port="80,81"; discard, bar=baz'])
[[('foo', 'bar'), ('port', '80,81'), ('discard', None)], [('bar', 'baz')]]
>>> split_header_words(['text/html; charset="iso-8859-1"'])
[[('text/html', None), ('charset', 'iso-8859-1')]]
>>> split_header_words([r'Basic realm="\"foo\bar\""'])
[[('Basic', None), ('realm', '"foobar"')]]
r% z\1N,z^[=\s;]*r r
zsplit_header_words bug: 'z', 'z', )
isinstancestrHEADER_TOKEN_RErc r re HEADER_QUOTED_VALUE_REHEADER_ESCAPE_REr HEADER_VALUE_RErstripappendr
startswithresubn)
header_valuesresultr orig_textpairsrg namevaluenon_junk
nr_junk_charss
r split_header_wordsr \ sy Z --- -
F &&t,A |wwqz*11$7$QE'..t4A (| !
% !% dE]+ ))#.{{}QR(&--. +-''+r4*H'-$q( . e-.( ? @ &--&G H Mr ([\"\\])c * g }| D ]| }g }|D ]P \ }}|8t j d| st j d| }d|z }|d|}|j | R |s]|j dj | ~ dj | S )a Do the inverse (almost) of the conversion done by split_header_words.
Takes a list of lists of (key, value) pairs and produces a single header
value. Attribute values are quoted if needed.
>>> join_header_words([[("text/plain", None), ("charset", "iso-8859-1")]])
'text/plain; charset="iso-8859-1"'
>>> join_header_words([[("text/plain", None)], [("charset", "iso-8859-1")]])
'text/plain, charset="iso-8859-1"'
z^\w+$\\\1z"%s"=; , )r rc HEADER_JOIN_ESCAPE_REr r join)listsheadersr attrkvs r join_header_wordsr s GDAq}yy1--11'1=A
A !$ KKN
$0 99W r c ^ | j d r| dd } | j d r| d d } | S )N"r% )r endswithr s r strip_quotesr s5 sABx }}SCRy Kr c d}g }| D ] }g }d}t |j d D ] \ }}|j }|j d \ }} }
|j }|s|dk( r nuE| r|
j nd}
|dk7 rF|j } | |v r| }|dk( r|
t |
}
d}n|d k( r|
t
t |
}
|j ||
f |s|s|j d
|j | |S ) a5 Ad-hoc parser for Netscape protocol cookie-attributes.
The old Netscape cookie format for Set-Cookie can for instance contain
an unquoted "," in the expires field, so we have to use this ad-hoc
parser instead of split_header_words.
XXX This may not make the best possible effort to parse all the crap
that Netscape Cookie headers contain. Ronald Tschalar's HTTPClient
parser is probably better, so could do worse than following that if
this ever gives any trouble.
Currently, this is also used for parsing RFC 2109 cookies.
)expiresdomainpathsecureversionportmax-ageF;r r
Nr Tr )r 0) enumeratesplitstrip partitionro r r r )
ns_headers known_attrsr ns_headerr version_setiiparamkeysepvallcs r parse_ns_headersr s 1K F #9??3#78IBKKME !OOC 0MCc))+C7 "%#))+$CQwYY[$ C)# *3 /"&KI% ' S(9 : LL#s $= 9@ -. MM% W Z Mr z\.\d+$c ^ t j | ry| dk( ry| d dk( s| d dk( ryy)z*Return True if text is a host domain name.Fr r
.r TIPV4_RErc r s r is_HDNr s8 ~~d rz Aw#~bS r c | j } |j }| |k( ryt | sy| j | }|dk( s|dk( ry|j d syt |dd syy)a Return True if domain A domain-matches domain B, according to RFC 2965.
A and B may be host domain names or IP addresses.
RFC 2965, section 1:
Host names can be specified either as an IP address or a HDN string.
Sometimes we compare one host name with another. (Such comparisons SHALL
be case-insensitive.) Host A's name domain-matches host B's if
* their host name strings string-compare equal; or
* A is a HDN string and has the form NB, where N is a non-empty
name string, B has the form .B', and B' is a HDN string. (So,
x.y.com domain-matches .Y.com but not Y.com.)
Note that domain-match is not a commutative operation: a.b.c.com
domain-matches .c.com, but not the reverse.
TFr r
r r% N)ro r rfindr )ABis r domain_matchr & sm .
A AAv !9
ABw!q& << !AB%= r c 0 t j | ryy)zdReturn True if text is a sort-of-like a host domain name.
For accepting/blocking domains.
FTr r s r liberal_is_HDNr M s ~~d r c | j } |j }t | r t | s| |k( ryy|j d }|r| j | ry|s| |k( ryy)z\For blocking/accepting domains.
A and B may be host domain names or IP addresses.
TFr )ro r r r )r r initial_dots r user_domain_matchr W sc
A A 1 ."3 6,,s#Kqzz!} 16 r z:\d+$c | j }t j j | d }|dk( r| j dd }t
j
d|d }|j S )zReturn request-host, as defined by RFC 2965.
Variation from RFC: returned value is lowercased, for convenient
comparison.
r% r Host) get_full_urlurllibparseurlparse
get_header cut_port_rer ro )requesturlhosts r request_hostr l sd
C << %a (D rz!!&"- ??2tQ 'D ::<r c 6 t | x}}d|vr|dz }||fS )zzReturn a tuple (request-host, effective request-host name).
As defined by RFC 2965, except both are lowercased.
r .local)r )r erhnreq_hosts r eff_request_hostr | s/ #7++D8
((" T>r c | j }t j j | }t |j
}|j
d sd|z }|S )z6Path component of request-URI, as defined by RFC 2965./)r r r urlsplit escape_pathr r )r r partsr s r request_pathr sL
C LL ! !# &E uzz "D ??3 Tz Kr c | j }|j d }|dk\ r||dz d } t | |S t
}|S # t $ r t d| Y y w xY w)N:r
r% znonnumeric port: '%s')r findrd rp r DEFAULT_HTTP_PORT)r r r r s r request_portr sl <>> reach("www.acme.com")
'.acme.com'
>>> reach("acme.com")
'acme.com'
>>> reach("acme.local")
'.local'
r r
r% Nlocal)r r )hr bs r reachr sU 4
s AAv
acdG
FF3K !9!q&ALq5L Hr c Z t | }t |t | j syy)z
RFC 2965, section 3.3.6:
An unverifiable transaction is to a third-party host if its request-
host U does not domain-match the reach R of the request-host O in the
origin transaction.
TF)r r r origin_req_host)r r s r is_third_partyr s) G$H %(?(?"@ Ar c B e Zd ZdZ d
dZd Zd dZd Zd dZd Z d Z
y) r a HTTP Cookie.
This class represents both Netscape and RFC 2965 cookies.
This is deliberately a very simple class. It just holds attributes. It's
possible to construct Cookie instances that don't comply with the cookie
standards. CookieJar.make_cookies is the factory function for Cookie
objects -- it deals with cookie parsing, supplying defaults, and
normalising to the representation used in this class. CookiePolicy is
responsible for checking them to see whether they should be accepted from
and returned to the server.
Note that the port may be present in the headers, but unspecified ("Port"
rather than"Port=80", for example); if this is the case, port is None.
c | t | }| t t | } ||du r t d || _ || _ || _ || _ || _ |j | _ || _
|| _ | | _ |
| _
| | _ | | _ |
| _ || _ || _ || _ t) j( | | _ y )NTz-if port is None, port_specified must be false)rd r rp r r r r port_specifiedro r domain_specifieddomain_initial_dotr path_specifiedr r discardcomment comment_urlrfc2109copy_rest)selfr r r r r r r r r r r r r r r restr s r __init__zCookie.__init__ s #g, #eGn*= r c | j d}nd| j z }| j |z | j z }| j | j d| j }n | j }d|d|dS )Nr r r z)r r r r r )r plimit namevalues r __str__zCookie.__str__0 sd 99 "adii-a a$))+ :: !#'99djj9I I'0%88r c \ g }dD ]- }t | | }|j |dt | / |j dt | j z |j dt | j z | j
j ddj | dS )N)r r r r r r r r r r r r r r r r zrest=%sz
rfc2109=%s(r ))getattrr reprr r __class____name__r )r r r r s r __repr__zCookie.__repr__: s D 4&D KK4d4 5
ITZZ 001 L4 #556 >>22DIIdODDr )Fr# ) r;
__module__ __qualname____doc__r! r% r) r+ r. r4 r< r r r r s1 6 (%T"-! 9 Er r c ( e Zd ZdZd Zd Zd Zd Zy)r a Defines which cookies get accepted from and returned to server.
May also modify cookies, though this is probably a bad idea.
The subclass DefaultCookiePolicy defines the standard rules for Netscape
and RFC 2965 cookies -- override that if you want a customized policy.
c t )zReturn true if (and only if) cookie should be accepted from server.
Currently, pre-expired cookies never get this far -- the CookieJar
class deletes such cookies itself.
NotImplementedErrorr cookier s r set_okzCookiePolicy.set_okR s
"##r c t )zAReturn true if (and only if) cookie should be returned to server.rC rE s r return_okzCookiePolicy.return_ok[ !##r c y)zMReturn false if cookies should not be returned, given cookie domain.
Tr@ )r r r s r domain_return_okz CookiePolicy.domain_return_ok_ r c y)zKReturn false if cookies should not be returned, given cookie path.
Tr@ )r r r s r path_return_okzCookiePolicy.path_return_okd rM r N)r; r= r> r? rG rI rL rO r@ r r r r I s $$
r r c
e Zd ZdZdZdZdZdZeez Zdddddddddeddd f
d
Z d Z
d Z d
Z d Z
d Zd Zd Zd Zd Zd Zd Zd Zd Zd Zd Zd Zd Zd Zd Z d Z d Z d Z y)!r zBImplements the standard rules for accepting and returning cookies.r% r r} r
NTF)httpswssc || _ || _ || _ || _ || _ || _ | | _ |
| _ | | _ | | _ |
| _
|t | | _ nd| _ | t | }|| _
y)zAConstructor arguments should be passed as keyword arguments only.Nr@ )netscaperfc2965rfc2109_as_netscape hide_cookie2
strict_domainstrict_rfc2965_unverifiablestrict_ns_unverifiablestrict_ns_domain strict_ns_set_initial_dollarstrict_ns_set_pathsecure_protocolstuple_blocked_domains_allowed_domains)r blocked_domainsallowed_domainsrT rU rV rW rX rY rZ r[ r\ r] r^ s r r! z DefaultCookiePolicy.__init__t s !
#6 ( *+F(&<# 0 ,H)"4 0 &$)/$:D !$&D ! & #O 4O / r c | j S )z4Return the sequence of blocked domains (as a tuple).)r` r s r rb z#DefaultCookiePolicy.blocked_domains $$$r c $ t | | _ y)z$Set the sequence of blocked domains.N)r_ r` )r rb s r set_blocked_domainsz'DefaultCookiePolicy.set_blocked_domains s %o 6 r c B | j D ] }t || s y yr- )r` r )r r blocked_domains r
is_blockedz DefaultCookiePolicy.is_blocked s$ " 3 3N 8 4 r c | j S )z=Return None, or the sequence of allowed domains (as a tuple).)ra re s r rc z#DefaultCookiePolicy.allowed_domains rf r c , | t | }|| _ y)z-Set the sequence of allowed domains, or None.N)r_ ra )r rc s r set_allowed_domainsz'DefaultCookiePolicy.set_allowed_domains s & #O 4O / r c \ | j y| j D ] }t || s y y)NFT)ra r )r r allowed_domains r is_not_allowedz"DefaultCookiePolicy.is_not_allowed s3 ( " 3 3N 8 4 r c t d|j |j |j J dD ] }d|z }t | | } ||| r y y)z
If you override .set_ok(), be sure to call this method. If it returns
false, so should your subclass (assuming your subclass wants to be more
strict about which cookies to accept).
- checking cookie %s=%s)r
verifiabilityr r r r set_ok_FTr r r r8 r rF r nfn_namefns r rG zDefaultCookiePolicy.set_ok s[ )6;; E{{&&&MA kGw'Bfg& N r c |j "t d|j |j y|j dkD r| j s t d y|j dk( r| j
s t d yy)Nz0 Set-Cookie2 without version attribute (%s=%s)Fr
$ RFC 2965 cookies are switched off$ Netscape cookies are switched offT)r r r r rU rT rE s r set_ok_versionz"DefaultCookiePolicy.set_ok_version sh >> !
E;;
. >>A dll 9 :
^^q
9 :r c |j rYt | rN|j dkD r| j r t d y|j dk( r| j
r t d yyNr
z> third-party RFC 2965 cookie during unverifiable transactionFz> third-party Netscape cookie during unverifiable transactionT unverifiabler r rY r rZ rE s r set_ok_verifiabilityz(DefaultCookiePolicy.set_ok_verifiability s] N7$;~~!d&F&F 8 9 1$)D)D 8 9 r c |j dk( r>| j r2|j j d rt d|j yy)Nr
$z' illegal name (starts with '$'): '%s'FT)r r\ r r r rE s r set_ok_namez DefaultCookiePolicy.set_ok_name s?
NNa D$E$E KK " "3 ' >A dll 9 :
^^q
9 :r c |j rYt | rN|j dkD r| j r t d y|j dk( r| j
r t d yyr r rE s r return_ok_verifiabilityz+DefaultCookiePolicy.return_ok_verifiabilityc s] N7$;~~!d&F&F % & 1$)D)D % & r c d |j r$|j | j vr t d yy)Nz( secure cookie with non-secure requestFT)r typer^ r rE s r return_ok_securez$DefaultCookiePolicy.return_ok_secureo s) ==W\\1F1F F = >r c R |j | j r t d yy)Nz cookie expiredFT)r. _nowr rE s r return_ok_expiresz%DefaultCookiePolicy.return_ok_expiresu s# TYY ' & 'r c |j rNt | }|d}|j j d D ] }||k( s y t d||j yy)Nr r z0 request port %s does not match cookie port %sFT)r r r r r s r return_ok_portz"DefaultCookiePolicy.return_ok_port{ sb ;;#G,H [[&&s+=
, I . r c t | \ }}|j }|r|j d sd|z }n|}|j dk( r6| j | j
z r |j s||k7 r t d y|j dkD rt || st d|| y|j dk( r"d|z j | st d|| yy)Nr r
zQ cookie with unspecified domain does not string-compare equal to request domainFzQ effective request-host name %s does not domain-match RFC 2965 cookie domain %sz; request-host %s does not match Netscape cookie domain %sT)
r r r r r[ DomainStrictNonDomainr r r r )r rF r r r r dotdomains r return_ok_domainz$DefaultCookiePolicy.return_ok_domain s )'2$ &++C0f I I
NNa
"
"T%?%?
?''FdN -
. >>A l4&@ /04f
> >>Q D':':9'E !6
+r c l t | \ }}|j d sd|z }|j d sd|z }|r|j d sd|z }n|}|j | s|j | sy| j | r
t d| y| j | r
t d| yy)Nr Fr r T)r r r rk r rq )r r r r r r s r rL z$DefaultCookiePolicy.domain_return_ok s *'2$""3'8|Hs#t8D &++C0f I I!!),
i0H ??6 " 7 @ v & ;V Dr c t d| t | }t | }||k( ry|j | r |j d s |||dz dk( ryt d|| y)Nz- checking cookie path=%sTr r% z %s does not path-match %sF)r r r r r )r r r r pathlens r rO z"DefaultCookiePolicy.path_return_ok sj *D1 (d) t !!$'}}S!Xggai%@C%G,h=r ) r; r= r> r? r r r
DomainLiberal DomainStrictr! rb rh rk rc rn rq rG r~ r r r r r rI r r r r r r rL rO r@ r r r r j s L M%&;;L "&t %) # $-1(-"/.3$)"2!0F%7 %0 &
:x*$
64 r r c # K t | j D ]- }d} |j d} t | E d{ | r*| / y7 # t $ r Y w xY ww)z)Iterates over nested mapping, depth-firstFTN)listvaluesitems
deepvaluesAttributeError)mappingobjs r r r sa GNN$% ' II G!# & &I &
' s7 A AA A
A A AA AA c e Zd Zy)AbsentNr; r= r> r@ r r r r r r c e Zd ZdZ ej
d Z ej
d Z ej
d Z ej
d Z ej
d Z
ej
dej Z d d Z
d
Zd Zd Zd
Zd Zd Zd Zd Zd Zd Zd Zd Zd Zd dZd Z d Z d Z d Z d Z d Z!y) r zCollection of HTTP cookies.
You may not need to know about this class: try
urllib.request.build_opener(HTTPCookieProcessor).open(url).
z\Wr z\.?[^.]*z[^.]*z^\.+z^\#LWP-Cookies-(\d+\.\d+)Nc j |
t }|| _ t j | _ i | _ y r# )r _policy
_threadingRLock
_cookies_lock_cookiesr policys r r! zCookieJar.__init__ s. >(*F ' - - /
r c || _ y r# )r r s r
set_policyzCookieJar.set_policy s r c g }| j j || sg S t d| | j | }|j D ]} }| j j || s || }|j
D ]F }| j j || s t d +t d |j | H |S )Nz!Checking %s for cookies to returnz not returning cookiez it's a match) r rL r r keysrO r rI r )r r r cookiescookies_by_pathr cookies_by_namerF s r _cookies_for_domainz CookieJar._cookies_for_domain s ||,,VW=I2F; --/#((*D<<..tW= -d 3O)002||--fg>45 ()v& 3 + r c g }| j j D ]# }|j | j || % |S )z2Return a list of cookies to be returned to server.)r r extendr )r r r r s r _cookies_for_requestz CookieJar._cookies_for_request
s< mm((*F NN433FGD E +r c |j d d d}g }|D ] }|j }|sd}|dkD r|j d|z |j Q| j j |j r,|dkD r'| j j d|j }n |j }|j |j |j n |j |j d | |dkD s|j r |j d
|j z |j j d rB|j }|j s|j d r|d d }|j d
|z |j yd}|j r|d|j z z }|j | |S )zReturn a list of cookie-attributes to be returned to server.
like ['foo="bar"; $Path="/"', ...]
The $Version attribute is also added when appropriate (currently only
once per request).
c , t | j S r# )r r )as r z)CookieJar._cookie_attrs.. s 3qvv;r T)r reverseFr
z $Version=%sNr r z
$Path="%s"r r% z $Domain="%s"z$Portz="%s")sortr r r non_word_rerc quote_rer r r r r r r r r ) r r r attrsrF r r r r1 s r
_cookie_attrszCookieJar._cookie_attrs s . = F nnG " Q;LL !89
) '' 5'A+
))'6<<@ ||# V[[) U ;<{((LL !;<==++C0 #]]F " 5 5 ))#.!'LL &!89;;* A ,, 6;;!6 7LLOQ T r c t d | j j t t j x| j
_ | _ | j | }| j | }|r2|j d s!|j ddj | | j
j rQ| j
j s;|j d s*|D ]% }|j dk7 s|j dd n | j j | j! y# | j j w xY w)zAdd correct Cookie: header to request (urllib.request.Request object).
The Cookie2 header is also added unless policy.hide_cookie2 is true.
add_cookie_headerr r Cookie2r% z $Version="1"N)r r acquirerd rq r r r r
has_headeradd_unredirected_headerr rU rW r releaseclear_expired_cookies)r r r r rF s r r zCookieJar.add_cookie_headerL s "# ""$ ),/ ,< R &
& & ( ""$
& & (s CE E E c ( g }d}d}|D ] }|d \ }}d}d} i }
i } |dd D ] \ } }
| j }||v s||v r|} | |v r|
d}
| |
v r-| dk( r!|
t d d} nw|
j }
| d
k( r|r[|
t d i| d k( r d} t |
}
d
} | j |
z }
| |v s| |v r |
| dvrt d| z d} n
|
|
| < |
| | < | r|j |||
| f |S # t $ r t d
d} Y 5w xY w)a Return list of tuples containing normalised cookie information.
attrs_set is the list of lists of key,value pairs extracted from
the Set-Cookie or Set-Cookie2 headers.
Tuples are name, value, standard, rest, where name and value are the
cookie name and value, standard is a dictionary containing the standard
cookie-attributes (discard, secure, version, expires or max-age,
domain, path and port) and rest is a dictionary containing the rest of
the cookie-attributes.
)r r )r r r r r r r
commenturlr
Fr% NTr z% missing value for domain attributer zM missing or invalid value for expires attribute: treating as session cookier z? missing or invalid (non-numeric) value for max-age attribute)r r r z! missing value for %s attribute)ro r rd rp r r )r attrs_set
cookie_tuples
boolean_attrs value_attrs cookie_attrsr r max_age_set
bad_cookiestandardr r r r s r _normalized_cookie_tuplesz#CookieJar._normalized_cookie_tuplesm s
+
0
&L&q/KD% K JHD$QR(1WWY$m(;A
%!) A= =y FG%)
A >" y F G >"&K F "A A
A$!}*< !BB BQ FG%)
"#HQK DGe )h $x!> ?Q &T 5 & 2 3%)
s C77DDc R |\ }}}}|j dt }|j dt }|j dt } |j dt }
|j dd } | t | } |j dd } |j dd }
|j d d }|j d
d }|t ur|d k7 rd }t | }nFd}t | }|j
d
}|dk7 r| dk( r|d | }n|d |dz }t | dk( rd
}|t u}d}|rt |j d }|t u rt | \ }}|}n|j d sd|z }d}| t ur(| t | } n d }t j dd | } nd } |
t u rd }
d }
n2|
| j k r# | j ||| t# d||| y t% | ||| ||||||| |
|
||| S # t $ r Y y w xY w# t $ r Y Cw xY w)Nr r r r r r Fr r r r Tr r r
r% r z\s+z2Expiring cookie, domain='%s', path='%s', name='%s')r' r rd rp r r r r boolr r r r r r clearKeyErrorr r )r tupr r r r r r r r r r r r r r r r r r r r r s r _cookie_from_cookie_tuplez#CookieJar._cookie_from_cookie_tuple sv '*#eXt h/||FF+||FF+,,y&1 ,,y$/
g, h.,,y%0,,y$/ ll<6 v $"* !N t$D "N (D
3ABwa< 8D 1:D4yA~ct "/ " !%f&7&7&.no_matching_rfc2965l s' #**INNINNJC f,,r )r get_allrd rq r r rU rT r r Exceptionr" r r r r r filterr )
r responser r rfc2965_hdrsns_hdrsrU rT r
ns_cookiesr rF r s
r make_cookieszCookieJar.make_cookies? sp --/ }b9 //,3(+DIIK(88 DI,,&&<<(( g h'I 22"<0';G x
! 9 9$W-w 8
) )* 5 %FHLFFMM6;; DE & ;A - $$7 D
z*C % 'G
)+
s$ 'E
E%
E"!E"%E=<E=c l | j j t t j x| j _ | _ | j j
|| r| j | | j j y# | j j w xY w)z-Set a cookie if policy says it's OK to do so.N) r r rd rq r r rG
set_cookier rE s r set_cookie_if_okzCookieJar.set_cookie_if_okv s~ ""$ ),/ ,< | j j y# | j j w xY w)zAExtract cookies from response, where allowable given the request.zextract_cookies: %sz setting cookie: %sN) r r r r r r rG r r )r r r rF s r extract_cookieszCookieJar.extract_cookies s $hmmo6 ""$ ) ++Hg><<&&vw70&9OOF+ ?
& & (D & & (s 1B# ( B# # B?c |#|| t d | j | | |= y| | t d | j | |= y|| j |= yi | _ y)a Clear some cookies.
Invoking this method without arguments will clear all cookies. If
given a single argument, only cookies belonging to that domain will be
removed. If given two arguments, cookies belonging to the specified
path within that domain are removed. If given three arguments, then
the cookie with the specified name, path and domain is removed.
Raises KeyError if no matching cookie exists.
Nz8domain and path must be given to remove a cookie by namez.domain must be given to remove cookies by path)rp r )r r r r s r r zCookieJar.clear s DL NP P
f%d+D1
~ DF F
f%d+
f% DMr c 8 | j j | D ]@ }|j s| j |j |j
|j B | j j y# | j j w xY w)zDiscard all session cookies.
Note that the .save() method won't save session cookies anyway, unless
you ask otherwise by passing a true ignore_discard argument.
N)r r r r r r r r )r rF s r clear_session_cookiesz CookieJar.clear_session_cookies so
""$ ) >>JJv}}fkk6;;G
& & (D & & (s A= 3A= = Bc j | j j t j }| D ]E }|j | s| j |j
|j |j G | j j y# | j j w xY w)a Discard all expired cookies.
You probably don't need to call this method: expired cookies are never
sent back to the server (provided you're using DefaultCookiePolicy),
this method is called by CookieJar itself every so often, and the
.save() method won't save expired cookies anyway (unless you ask
otherwise by passing a true ignore_expires argument).
N) r r rq r. r r r r r )r rK rF s r r z CookieJar.clear_expired_cookies s
""$ )))+C $$S)JJv}}fkk6;;G
& & (D & & (s *B 3B B2c , t | j S r# )r r re s r __iter__zCookieJar.__iter__ s $--((r c " d}| D ] }|dz } |S )z#Return number of contained cookies.r
r% r@ )r r rF s r __len__zCookieJar.__len__ s
FAAdr c g }| D ] }|j t | d| j j ddj | dS N<[r z]>)r r9 r: r; r r rrF s r r< zCookieJar.__repr__ s: FAHHT&\ 2d !^^ 4 4diilCCr c g }| D ] }|j t | d| j j ddj | dS r. )r r r: r; r r1 s r r4 zCookieJar.__str__ s: FAHHS[ 1d !^^ 4 4diilCCr r# )NNN)"r; r= r> r? r compiler r strict_domain_re domain_redots_reASCIImagic_rer! r r r r r r r r r r r r r$ r r' r r* r, r< r4 r@ r r r r s "**U#Krzz+&H!rzz+.
8$Ibjj!Grzz6AH $9v %B_ BZ x
'5n ) )
) 6
) )&) D
Dr r c e Zd Zy)r Nr r@ r r r r r r r c 4 e Zd ZdZddZddZddZ ddZy) r z6CookieJar that can be loaded from and saved to a file.Nc t j | | |t j | }|| _ t | | _ y)z}
Cookies are NOT loaded from the named file until either the .load() or
.revert() method is called.
N)r r! osfspathfilenamer delayload)r r? r@ r s r r! zFileCookieJar.__init__ s: 4( yy*H
i r c t )zSave cookies to a file.rC )r r? ignore_discardignore_expiress r savezFileCookieJar.save rJ r c |(| j
| j }nt t t | 5 }| j |||| ddd y# 1 sw Y yxY w)zLoad cookies from a file.N)r? rp MISSING_FILENAME_TEXTopen _really_loadr r? rB rC r s r loadzFileCookieJar.load sM }}(T]]("#899
(^q a>> J ^^s AA c |(| j
| j }nt t | j j t j | j }i | _ | j ||| | j j y# t $ r || _ w xY w# | j j w xY w)zClear all cookies and reload cookies from a saved file.
Raises LoadError (or OSError) if reversion is not successful; the
object's state will not be altered if this happens.
N) r? rp rF r r r deepcopyr rJ OSErrorr )r r? rB rC old_states r revertzFileCookieJar.revert s }}(T]]("#899 ""$ )
dmm4I DM
(NNC
& & (
)
& & (s &B1 -B B..B1 1 C
)NFNNFF)r; r= r> r? r! rD rJ rO r@ r r r r s" @
)$K #49)r r c | j | j fd| j fd| j fg}| j |j d| j f | j r|j d | j r|j d | j r|j d | j r|j d | j r/|j dt t | j f | j r|j d | j r |j d
| j f | j r |j d | j f t! | j" j% }|D ]+ }|j |t' | j" | f - |j d t' | j( f t+ |g S )
zReturn string representation of Cookie in the LWP cookie file format.
Actually, the format is extended a bit -- see module docstring.
r r r ) path_specN) port_specN)
domain_dotN)r Nr )r Nr r r )r r r r r r r r r r r rT r r r r sortedr r r r r )rF r
r r s r lwp_cookie_strrV ' s ++v|| $
&++
FMM " $A {{ &&++)> ?
ahh': ;
ahh': ;
!((+?"@
}}ahh /0
~~qxx (v~~)> ?!A B
~~qxx 12
~~qxxFNN ;<
188\63E3E$FG &,,##% &D
!S a )*+ HHiV^^,
-. aS !!r c & e Zd ZdZddZddZd Zy)r a[
The LWPCookieJar saves a sequence of "Set-Cookie3" lines.
"Set-Cookie3" is the format used by the libwww-perl library, not known
to be compatible with any browser, but which is easy to read and
doesn't lose information about RFC 2965 cookies.
Additional methods
as_lwp_str(ignore_discard=True, ignore_expired=True)
c t j }g }| D ]B }|s
|j r|s|j | r&|j dt | z D dj |dgz S )zReturn cookies as a string of "\n"-separated "Set-Cookie3" headers.
ignore_discard and ignore_expires: see docstring for FileCookieJar.save
zSet-Cookie3: %s
r )rq r r. r rV r )r rB rC rK r2 rF s r
as_lwp_strzLWPCookieJar.as_lwp_strP sk iik F!fnn!f&7&7&<
HH& )?? @ yyB4 r Nc |(| j
| j }nt t t j t j
|t j t j z t j z d d 5 }|j d |j | j || d d d y # 1 sw Y y xY w)N wz#LWP-Cookies-2.0
) r? rp rF r= fdopenrG O_CREATO_WRONLYO_TRUNCwriterZ rI s r rD zLWPCookieJar.save` s }}(T]]("#899
YY GGHbjj2;; 6 CU K
GG( )
GGDOONNC D
s 3CC c J |j }| j j | sd|z }t | t j }d}d} d}
|j x} dk7 r| j | s(| t
| d j } t | g D ]0 } | d \ }
}i }i }| D ] }d||< | dd D ]A \ }}||j }nd }||
v s|| v r|}|| v r
|d }|||< 3||
v r|||< =|||< C |j } |d
} |d }| t | }|d } |d }|j d
}t |d |
| |d |d || |d |d |d |d || |d |d | }|s|j r |s|j | r | j | 3 |j x} dk7 ry y # t $ r t" $ r t% t d|d w xY w)Nz5%r does not look like a Set-Cookie3 (LWP) format filez Set-Cookie3:)rS rR rT r r )r r r r r r r r r
Fr% Tr r r r r r rS rT r rR r r r z invalid Set-Cookie3 format file : )readliner9 rc r rq r r r r ro r' r r r r. r rM r r" )r r r? rB rC magicr! rK headerr r linedatar r r r r r r r
r r r r r s r rH zLWPCookieJar._really_loado sf
}}##E* $%CC. iik .
0
9 . ::<'4B.v. CKL)//1 .v 6D"&q'KD% !H D *&+ + $QR1 =!"B!%B + -2 3F "A
- yd!*+HQK + -*+HQK&'DG !) ! A lG lG *"*7"3 "& x[F'-'8'8'=$ q|T5 y!K. %'7< y!K. { & & | # %A *aii )all3.? OOA&[ 7 ::<'4B.f . % ' %t - .
. .s
FG4 4.H")TTrP )r; r= r> r? rZ rD rH r@ r r r r C s
!
E J.r r c e Zd ZdZd ZddZy)r a
WARNING: you may want to backup your browser's cookies file if you use
this class to save cookies. I *think* it works, but there have been
bugs in the past!
This class differs from CookieJar only in the format it uses to save and
load cookies to and from a file. This class uses the Mozilla/Netscape
`cookies.txt' format. curl and lynx use this file format, too.
Don't expect cookies saved while the browser is running to be noticed by
the browser (in fact, Mozilla on unix will overwrite your saved cookies if
you change them on disk while it's running; on Windows, you probably can't
save at all while the browser is running).
Note that the Mozilla/Netscape format will downgrade RFC2965 cookies to
Netscape cookies on saving.
In particular, the cookie version and port number information is lost,
together with information about whether or not Path, Port and Discard were
specified by the Set-Cookie2 (or Set-Cookie) header, and whether or not the
domain as set in the HTTP header started with a dot (yes, I'm aware some
domains in Netscape files start with a dot and some don't -- trust me, you
really don't want to know any more about this).
Note that though Mozilla and Netscape use the same format, they use
slightly different headers. The class saves cookies using the Netscape
header by default (Mozilla can cope with that).
c t j }t j |j st d|z |j x}dk7 r2i }|j t rd|t < |t t d }|j d r|d d }|j j d s|j dk( r|j d \ }} }
} } }
}| dk( } | dk( } |
dk( r|}
d }|j d }| |k( sJ d }| dk( rd } d
}t d |
|d d || ||
d | | |d d | }|s|j r
|s|j | r | j | |j x}dk7 r1y y # t $ r t" $ r t% t d |d
w xY w)Nz4%r does not look like a Netscape format cookies filer rY r )#r TRUEr FTr
z%invalid Netscape format cookies file rd )rq NETSCAPE_MAGIC_RGXr re r r HTTPONLY_PREFIX
HTTPONLY_ATTRr r r r r r r. r rM r r" )r r r? rB rC rK rh r r r r r r r r r r r s r rH z MozillaCookieJar._really_load s iik!''
5F
< . ::<'4B.
???3*,D ' O 4 56D ==&tCRy JJL++J7JJLB&
4( M($u F*$4$> 2: !D E $ / / 4 ';666 b= "G "G 1dE !#3[ !"" ! &!)) %!,,s*; "i ::<'4B.l . % ' %t - .
. .s
EF .F>Nc
|(| j
| j }nt t t j t j
|t j t j z t j z d d 5 }|j t t j }| D ] }|j }|s
|j r |s|j | r3|j rd}nd}|j! d rd} nd} |j" t% |j" }
nd}
|j& d} |j( } n|j( } |j& } |j+ t, r t. |z }|j dj1 || |j2 ||
| | g dz d d d y # 1 sw Y y xY w) Nr\ r] rn FALSEr r rm rY )r? rp rF r= r^ rG r_ r` ra rb NETSCAPE_HEADER_TEXTrq r r r. r r r r r r r% rq rp r r )
r r? rB rC r rK rF r r r r r r s
r rD zMozillaCookieJar.save" sz }}(T]]("#899
YY GGHbjj2;; 6 CU K
GG( )))+C %&.. %&*;*;C*@ ==6& &f$$S);$+k>>- !&.. 1G G<<' D "KKE!;;D "LLE..}= ,v 5FIIv{FKK %we = >3
s
D2GG rP )r; r= r> r? rH rD r@ r r r r s >D.L'r r r# )Yr? __all__r= r rJ r rq urllib.parser urllib.request threadingr http.clienthttpcalendarr r
r r rq rp r client HTTP_PORTr r4 ro rF rt r" r+ r3 rV rX ro rm rT rY ra r8 rb rh r{ r Ir Xr r r r r r r r r r r r r r r r r r r r r r r r r r
r r r r r r r r r r rM r r rV r r )r. s 0r r s 6 M
#
--. RZZ @A : A
9
4+126%
62 B&0( T = bjj5rxx@ 6
p ,-/XX7 RZZ2BDD288OE
RZZ &
DD288O) *65p bjj
44")) # $5B3
$$67#$MN #$9: 2::h' Sj #
;/ 2AH "**Y
)
%N( bjj288, $ "** 9:+ !
F"_E _ED B_, _B " LD LD` 4)I 4)n"8v.= v.rM} MA; 3s J0