Developer Interface¶
This part of the documentation covers all the interfaces of Requests. Forparts where Requests depends on external libraries, we document the mostimportant right here and provide links to the canonical documentation.
Main Interface¶
All of Requests’ functionality can be accessed by these 7 methods.They all return an instance of theResponse object.
- requests.request(method,url,**kwargs)[source]¶
Constructs and sends a
Request.- Parameters:
method – method for the new
Requestobject:GET,OPTIONS,HEAD,POST,PUT,PATCH, orDELETE.url – URL for the new
Requestobject.params – (optional) Dictionary, list of tuples or bytes to sendin the query string for the
Request.data – (optional) Dictionary, list of tuples, bytes, or file-likeobject to send in the body of the
Request.json – (optional) A JSON serializable Python object to send in the body of the
Request.headers – (optional) Dictionary of HTTP Headers to send with the
Request.cookies – (optional) Dict or CookieJar object to send with the
Request.files – (optional) Dictionary of
'name':file-like-objects(or{'name':file-tuple}) for multipart encoding upload.file-tuplecan be a 2-tuple('filename',fileobj), 3-tuple('filename',fileobj,'content_type')or a 4-tuple('filename',fileobj,'content_type',custom_headers), where'content_type'is a stringdefining the content type of the given file andcustom_headersa dict-like object containing additional headersto add for the file.auth – (optional) Auth tuple to enable Basic/Digest/Custom HTTP Auth.
timeout (float ortuple) – (optional) How many seconds to wait for the server to send databefore giving up, as a float, or a(connect timeout, readtimeout) tuple.
allow_redirects (bool) – (optional) Boolean. Enable/disable GET/OPTIONS/POST/PUT/PATCH/DELETE/HEAD redirection. Defaults to
True.proxies – (optional) Dictionary mapping protocol to the URL of the proxy.
verify – (optional) Either a boolean, in which case it controls whether we verifythe server’s TLS certificate, or a string, in which case it must be a pathto a CA bundle to use. Defaults to
True.stream – (optional) if
False, the response content will be immediately downloaded.cert – (optional) if String, path to ssl client cert file (.pem). If Tuple, (‘cert’, ‘key’) pair.
- Returns:
Responseobject- Return type:
Usage:
>>>importrequests>>>req=requests.request('GET','https://httpbin.org/get')>>>req<Response [200]>
- requests.head(url,**kwargs)[source]¶
Sends a HEAD request.
- Parameters:
- Returns:
Responseobject- Return type:
- requests.get(url,params=None,**kwargs)[source]¶
Sends a GET request.
- Parameters:
- Returns:
Responseobject- Return type:
- requests.post(url,data=None,json=None,**kwargs)[source]¶
Sends a POST request.
- Parameters:
- Returns:
Responseobject- Return type:
- requests.put(url,data=None,**kwargs)[source]¶
Sends a PUT request.
- Parameters:
- Returns:
Responseobject- Return type:
- requests.patch(url,data=None,**kwargs)[source]¶
Sends a PATCH request.
- Parameters:
- Returns:
Responseobject- Return type:
Exceptions¶
- exceptionrequests.RequestException(*args,**kwargs)[source]¶
There was an ambiguous exception that occurred while handling yourrequest.
- exceptionrequests.ConnectTimeout(*args,**kwargs)[source]¶
The request timed out while trying to connect to the remote server.
Requests that produced this error are safe to retry.
- exceptionrequests.ReadTimeout(*args,**kwargs)[source]¶
The server did not send any data in the allotted amount of time.
- exceptionrequests.Timeout(*args,**kwargs)[source]¶
The request timed out.
Catching this error will catch both
ConnectTimeoutandReadTimeouterrors.
Request Sessions¶
- classrequests.Session[source]¶
A Requests session.
Provides cookie persistence, connection-pooling, and configuration.
Basic Usage:
>>>importrequests>>>s=requests.Session()>>>s.get('https://httpbin.org/get')<Response [200]>
Or as a context manager:
>>>withrequests.Session()ass:...s.get('https://httpbin.org/get')<Response [200]>
- cert¶
SSL client certificate default, if String, path to ssl clientcert file (.pem). If Tuple, (‘cert’, ‘key’) pair.
- cookies¶
A CookieJar containing all currently outstanding cookies set on thissession. By default it is a
RequestsCookieJar, butmay be any othercookielib.CookieJarcompatible object.
- delete(url,**kwargs)[source]¶
Sends a DELETE request. Returns
Responseobject.- Parameters:
url – URL for the new
Requestobject.**kwargs – Optional arguments that
requesttakes.
- Return type:
- get(url,**kwargs)[source]¶
Sends a GET request. Returns
Responseobject.- Parameters:
url – URL for the new
Requestobject.**kwargs – Optional arguments that
requesttakes.
- Return type:
- get_redirect_target(resp)¶
Receives a Response. Returns a redirect URI or
None
- head(url,**kwargs)[source]¶
Sends a HEAD request. Returns
Responseobject.- Parameters:
url – URL for the new
Requestobject.**kwargs – Optional arguments that
requesttakes.
- Return type:
- hooks¶
Event-handling hooks.
- max_redirects¶
Maximum number of redirects allowed. If the request exceeds thislimit, a
TooManyRedirectsexception is raised.This defaults to requests.models.DEFAULT_REDIRECT_LIMIT, which is30.
- merge_environment_settings(url,proxies,stream,verify,cert)[source]¶
Check the environment and merge it with some settings.
- Return type:
- mount(prefix,adapter)[source]¶
Registers a connection adapter to a prefix.
Adapters are sorted in descending order by prefix length.
- options(url,**kwargs)[source]¶
Sends a OPTIONS request. Returns
Responseobject.- Parameters:
url – URL for the new
Requestobject.**kwargs – Optional arguments that
requesttakes.
- Return type:
- params¶
Dictionary of querystring data to attach to each
Request. The dictionary values may be lists forrepresenting multivalued query parameters.
- patch(url,data=None,**kwargs)[source]¶
Sends a PATCH request. Returns
Responseobject.- Parameters:
- Return type:
- post(url,data=None,json=None,**kwargs)[source]¶
Sends a POST request. Returns
Responseobject.- Parameters:
- Return type:
- prepare_request(request)[source]¶
Constructs a
PreparedRequestfortransmission and returns it. ThePreparedRequesthas settingsmerged from theRequestinstance and those of theSession.- Parameters:
request –
Requestinstance to prepare with thissession’s settings.- Return type:
- proxies¶
Dictionary mapping protocol or protocol and host to the URL of the proxy(e.g. {‘http’: ‘foo.bar:3128’, ‘http://host.name’: ‘foo.bar:4012’}) tobe used on each
Request.
- put(url,data=None,**kwargs)[source]¶
Sends a PUT request. Returns
Responseobject.- Parameters:
- Return type:
- rebuild_auth(prepared_request,response)¶
When being redirected we may want to strip authentication from therequest to avoid leaking credentials. This method intelligently removesand reapplies authentication where possible to avoid credential loss.
- rebuild_method(prepared_request,response)¶
When being redirected we may want to change the method of the requestbased on certain specs or browser behavior.
- rebuild_proxies(prepared_request,proxies)¶
This method re-evaluates the proxy configuration by considering theenvironment variables. If we are redirected to a URL covered byNO_PROXY, we strip the proxy configuration. Otherwise, we set missingproxy keys for this URL (in case they were stripped by a previousredirect).
This method also replaces the Proxy-Authorization header wherenecessary.
- Return type:
- request(method,url,params=None,data=None,headers=None,cookies=None,files=None,auth=None,timeout=None,allow_redirects=True,proxies=None,hooks=None,stream=None,verify=None,cert=None,json=None)[source]¶
Constructs a
Request, prepares it and sends it.ReturnsResponseobject.- Parameters:
method – method for the new
Requestobject.url – URL for the new
Requestobject.params – (optional) Dictionary or bytes to be sent in the querystring for the
Request.data – (optional) Dictionary, list of tuples, bytes, or file-likeobject to send in the body of the
Request.json – (optional) json to send in the body of the
Request.headers – (optional) Dictionary of HTTP Headers to send with the
Request.cookies – (optional) Dict or CookieJar object to send with the
Request.files – (optional) Dictionary of
'filename':file-like-objectsfor multipart encoding upload.auth – (optional) Auth tuple or callable to enableBasic/Digest/Custom HTTP Auth.
timeout (float ortuple) – (optional) How many seconds to wait for the server to senddata before giving up, as a float, or a(connect timeout,read timeout) tuple.
allow_redirects (bool) – (optional) Set to True by default.
proxies – (optional) Dictionary mapping protocol or protocol andhostname to the URL of the proxy.
hooks – (optional) Dictionary mapping hook name to one event orlist of events, event must be callable.
stream – (optional) whether to immediately download the responsecontent. Defaults to
False.verify – (optional) Either a boolean, in which case it controls whether we verifythe server’s TLS certificate, or a string, in which case it must be a pathto a CA bundle to use. Defaults to
True. When set toFalse, requests will accept any TLS certificate presented bythe server, and will ignore hostname mismatches and/or expiredcertificates, which will make your application vulnerable toman-in-the-middle (MitM) attacks. Setting verify toFalsemay be useful during local development or testing.cert – (optional) if String, path to ssl client cert file (.pem).If Tuple, (‘cert’, ‘key’) pair.
- Return type:
- resolve_redirects(resp,req,stream=False,timeout=None,verify=True,cert=None,proxies=None,yield_requests=False,**adapter_kwargs)¶
Receives a Response. Returns a generator of Responses or Requests.
- should_strip_auth(old_url,new_url)¶
Decide whether Authorization header should be removed when redirecting
- stream¶
Stream response content default.
- trust_env¶
Trust environment settings for proxy configuration, defaultauthentication and similar.
- verify¶
SSL Verification default.Defaults toTrue, requiring requests to verify the TLS certificate at theremote end.If verify is set toFalse, requests will accept any TLS certificatepresented by the server, and will ignore hostname mismatches and/orexpired certificates, which will make your application vulnerable toman-in-the-middle (MitM) attacks.Only set this toFalse for testing.
Lower-Level Classes¶
- classrequests.Request(method=None,url=None,headers=None,files=None,data=None,params=None,auth=None,cookies=None,hooks=None,json=None)[source]¶
A user-created
Requestobject.Used to prepare a
PreparedRequest, which is sent to the server.- Parameters:
method – HTTP method to use.
url – URL to send.
headers – dictionary of headers to send.
files – dictionary of {filename: fileobject} files to multipart upload.
data – the body to attach to the request. If a dictionary orlist of tuples
[(key,value)]is provided, form-encoding willtake place.json – json for the body to attach to the request (if files or data is not specified).
params – URL parameters to append to the URL. If a dictionary orlist of tuples
[(key,value)]is provided, form-encoding willtake place.auth – Auth handler or (user, pass) tuple.
cookies – dictionary or CookieJar of cookies to attach to this request.
hooks – dictionary of callback hooks, for internal usage.
Usage:
>>>importrequests>>>req=requests.Request('GET','https://httpbin.org/get')>>>req.prepare()<PreparedRequest [GET]>
- deregister_hook(event,hook)¶
Deregister a previously registered hook.Returns True if the hook existed, False if not.
- prepare()[source]¶
Constructs a
PreparedRequestfor transmission and returns it.
- register_hook(event,hook)¶
Properly register a hook.
- classrequests.Response[source]¶
The
Responseobject, which contains aserver’s response to an HTTP request.- propertyapparent_encoding¶
The apparent encoding, provided by the charset_normalizer or chardet libraries.
- close()[source]¶
Releases the connection back to the pool. Once this method has beencalled the underlying
rawobject must not be accessed again.Note: Should not normally need to be called explicitly.
- propertycontent¶
Content of the response, in bytes.
- cookies¶
A CookieJar of Cookies the server sent back.
- elapsed¶
The amount of time elapsed between sending the requestand the arrival of the response (as a timedelta).This property specifically measures the time taken between sendingthe first byte of the request and finishing parsing the headers. Itis therefore unaffected by consuming the response content or thevalue of the
streamkeyword argument.
- encoding¶
Encoding to decode with when accessing r.text.
- headers¶
Case-insensitive Dictionary of Response Headers.For example,
headers['content-encoding']will return thevalue of a'Content-Encoding'response header.
- history¶
A list of
Responseobjects fromthe history of the Request. Any redirect responses will endup here. The list is sorted from the oldest to the most recent request.
- propertyis_permanent_redirect¶
True if this Response one of the permanent versions of redirect.
- propertyis_redirect¶
True if this Response is a well-formed HTTP redirect that could havebeen processed automatically (by
Session.resolve_redirects).
- iter_content(chunk_size=1,decode_unicode=False)[source]¶
Iterates over the response data. When stream=True is set on therequest, this avoids reading the content at once into memory forlarge responses. The chunk size is the number of bytes it shouldread into memory. This is not necessarily the length of each itemreturned as decoding can take place.
chunk_size must be of type int or None. A value of None willfunction differently depending on the value ofstream.stream=True will read data as it arrives in whatever size thechunks are received. If stream=False, data is returned asa single chunk.
If decode_unicode is True, content will be decoded using the bestavailable encoding based on the response.
- iter_lines(chunk_size=512,decode_unicode=False,delimiter=None)[source]¶
Iterates over the response data, one line at a time. Whenstream=True is set on the request, this avoids reading thecontent at once into memory for large responses.
Note
This method is not reentrant safe.
- json(**kwargs)[source]¶
Decodes the JSON response body (if any) as a Python object.
This may return a dictionary, list, etc. depending on what is in the response.
- Parameters:
**kwargs – Optional arguments that
json.loadstakes.- Raises:
requests.exceptions.JSONDecodeError – If the response body does notcontain valid json.
- propertylinks¶
Returns the parsed header links of the response, if any.
- propertynext¶
Returns a PreparedRequest for the next request in a redirect chain, if there is one.
- propertyok¶
Returns True if
status_codeis less than 400, False if not.This attribute checks if the status code of the response is between400 and 600 to see if there was a client error or a server error. Ifthe status code is between 200 and 400, this will return True. Thisisnot a check to see if the response code is
200OK.
- raw¶
File-like object representation of response (for advanced usage).Use of
rawrequires thatstream=Truebe set on the request.This requirement does not apply for use internally to Requests.
- reason¶
Textual reason of responded HTTP Status, e.g. “Not Found” or “OK”.
- request¶
The
PreparedRequestobject to which thisis a response.
- status_code¶
Integer Code of responded HTTP Status, e.g. 404 or 200.
- propertytext¶
Content of the response, in unicode.
If Response.encoding is None, encoding will be guessed using
charset_normalizerorchardet.The encoding of the response content is determined based solely on HTTPheaders, following RFC 2616 to the letter. If you can take advantage ofnon-HTTP knowledge to make a better guess at the encoding, you shouldset
r.encodingappropriately before accessing this property.
- url¶
Final URL location of Response.
Lower-Lower-Level Classes¶
- classrequests.PreparedRequest[source]¶
The fully mutable
PreparedRequestobject,containing the exact bytes that will be sent to the server.Instances are generated from a
Requestobject, andshould not be instantiated manually; doing so may produce undesirableeffects.Usage:
>>>importrequests>>>req=requests.Request('GET','https://httpbin.org/get')>>>r=req.prepare()>>>r<PreparedRequest [GET]>>>>s=requests.Session()>>>s.send(r)<Response [200]>
- body¶
request body to send to the server.
- deregister_hook(event,hook)¶
Deregister a previously registered hook.Returns True if the hook existed, False if not.
- headers¶
dictionary of HTTP headers.
- hooks¶
dictionary of callback hooks, for internal usage.
- method¶
HTTP verb to send to the server.
- propertypath_url¶
Build the path URL to use.
- prepare(method=None,url=None,headers=None,files=None,data=None,params=None,auth=None,cookies=None,hooks=None,json=None)[source]¶
Prepares the entire request with the given parameters.
- prepare_cookies(cookies)[source]¶
Prepares the given HTTP cookie data.
This function eventually generates a
Cookieheader from thegiven cookies using cookielib. Due to cookielib’s design, the headerwill not be regenerated if it already exists, meaning this functioncan only be called once for the life of thePreparedRequestobject. Any subsequent callstoprepare_cookieswill have no actual effect, unless the “Cookie”header is removed beforehand.
- register_hook(event,hook)¶
Properly register a hook.
- url¶
HTTP URL to send the request to.
- classrequests.adapters.BaseAdapter[source]¶
The Base Transport Adapter
- send(request,stream=False,timeout=None,verify=True,cert=None,proxies=None)[source]¶
Sends PreparedRequest object. Returns Response object.
- Parameters:
request – The
PreparedRequestbeing sent.stream – (optional) Whether to stream the request content.
timeout (float ortuple) – (optional) How long to wait for the server to senddata before giving up, as a float, or a(connect timeout,read timeout) tuple.
verify – (optional) Either a boolean, in which case it controls whether we verifythe server’s TLS certificate, or a string, in which case it must be a pathto a CA bundle to use
cert – (optional) Any user-provided SSL certificate to be trusted.
proxies – (optional) The proxies dictionary to apply to the request.
- classrequests.adapters.HTTPAdapter(pool_connections=10,pool_maxsize=10,max_retries=0,pool_block=False)[source]¶
The built-in HTTP Adapter for urllib3.
Provides a general-case interface for Requests sessions to contact HTTP andHTTPS urls by implementing the Transport Adapter interface. This class willusually be created by the
Sessionclass under thecovers.- Parameters:
pool_connections – The number of urllib3 connection pools to cache.
pool_maxsize – The maximum number of connections to save in the pool.
max_retries – The maximum number of retries each connectionshould attempt. Note, this applies only to failed DNS lookups, socketconnections and connection timeouts, never to requests where data hasmade it to the server. By default, Requests does not retry failedconnections. If you need granular control over the conditions underwhich we retry a request, import urllib3’s
Retryclass and passthat instead.pool_block – Whether the connection pool should block for connections.
Usage:
>>>importrequests>>>s=requests.Session()>>>a=requests.adapters.HTTPAdapter(max_retries=3)>>>s.mount('http://',a)
- add_headers(request,**kwargs)[source]¶
Add any headers needed by the connection. As of v2.0 this doesnothing by default, but is left for overriding by users that subclassthe
HTTPAdapter.This should not be called from user code, and is only exposed for usewhen subclassing the
HTTPAdapter.- Parameters:
request – The
PreparedRequestto add headers to.kwargs – The keyword arguments from the call to send().
- build_connection_pool_key_attributes(request,verify,cert=None)[source]¶
Build the PoolKey attributes used by urllib3 to return a connection.
This looks at the PreparedRequest, the user-specified verify value,and the value of the cert parameter to determine what PoolKey valuesto use to select a connection from a given urllib3 Connection Pool.
The SSL related pool key arguments are not consistently set. As ofthis writing, use the following to determine what keys may be in thatdictionary:
If
verifyisTrue,"ssl_context"will be set and will be thedefault Requests SSL ContextIf
verifyisFalse,"ssl_context"will not be set but"cert_reqs"will be setIf
verifyis a string, (i.e., it is a user-specified trust bundle)"ca_certs"will be set if the string is not a directory recognizedbyos.path.isdir, otherwise"ca_cert_dir"will beset.If
"cert"is specified,"cert_file"will always be set. If"cert"is a tuple with a second item,"key_file"will alsobe present
To override these settings, one may subclass this class, call thismethod and use the above logic to change parameters as desired. Forexample, if one wishes to use a custom
ssl.SSLContextonemust both set"ssl_context"and based on what else they require,alter the other keys to ensure the desired behaviour.- Parameters:
request (
PreparedRequest) – The PreparedReqest being sent over the connection.verify – Either a boolean, in which case it controls whetherwe verify the server’s TLS certificate, or a string, in which case itmust be a path to a CA bundle to use.
cert – (optional) Any user-provided SSL certificate for clientauthentication (a.k.a., mTLS). This may be a string (i.e., justthe path to a file which holds both certificate and key) or atuple of length 2 with the certificate file path and key filepath.
- Returns:
A tuple of two dictionaries. The first is the “host parameters”portion of the Pool Key including scheme, hostname, and port. Thesecond is a dictionary of SSLContext related parameters.
- build_response(req,resp)[source]¶
Builds a
Responseobject from a urllib3response. This should not be called from user code, and is only exposedfor use when subclassing theHTTPAdapter- Parameters:
req – The
PreparedRequestused to generate the response.resp – The urllib3 response object.
- Return type:
- cert_verify(conn,url,verify,cert)[source]¶
Verify a SSL certificate. This method should not be called from usercode, and is only exposed for use when subclassing the
HTTPAdapter.- Parameters:
conn – The urllib3 connection object associated with the cert.
url – The requested URL.
verify – Either a boolean, in which case it controls whether we verifythe server’s TLS certificate, or a string, in which case it must be a pathto a CA bundle to use
cert – The SSL certificate to verify.
- close()[source]¶
Disposes of any internal state.
Currently, this closes the PoolManager and any active ProxyManager,which closes any pooled connections.
- get_connection(url,proxies=None)[source]¶
DEPRECATED: Users should move toget_connection_with_tls_contextfor all subclasses of HTTPAdapter using Requests>=2.32.2.
Returns a urllib3 connection for the given URL. This should not becalled from user code, and is only exposed for use when subclassing the
HTTPAdapter.- Parameters:
url – The URL to connect to.
proxies – (optional) A Requests-style dictionary of proxies used on this request.
- Return type:
urllib3.ConnectionPool
- get_connection_with_tls_context(request,verify,proxies=None,cert=None)[source]¶
Returns a urllib3 connection for the given request and TLS settings.This should not be called from user code, and is only exposed for usewhen subclassing the
HTTPAdapter.- Parameters:
request – The
PreparedRequestobject to be sentover the connection.verify – Either a boolean, in which case it controls whether we verify theserver’s TLS certificate, or a string, in which case it must be apath to a CA bundle to use.
proxies – (optional) The proxies dictionary to apply to the request.
cert – (optional) Any user-provided SSL certificate to be used for clientauthentication (a.k.a., mTLS).
- Return type:
urllib3.ConnectionPool
- init_poolmanager(connections,maxsize,block=False,**pool_kwargs)[source]¶
Initializes a urllib3 PoolManager.
This method should not be called from user code, and is onlyexposed for use when subclassing the
HTTPAdapter.- Parameters:
connections – The number of urllib3 connection pools to cache.
maxsize – The maximum number of connections to save in the pool.
block – Block when no free connections are available.
pool_kwargs – Extra keyword arguments used to initialize the Pool Manager.
- proxy_headers(proxy)[source]¶
Returns a dictionary of the headers to add to any request sentthrough a proxy. This works with urllib3 magic to ensure that they arecorrectly sent to the proxy, rather than in a tunnelled request ifCONNECT is being used.
This should not be called from user code, and is only exposed for usewhen subclassing the
HTTPAdapter.- Parameters:
proxy – The url of the proxy being used for this request.
- Return type:
- proxy_manager_for(proxy,**proxy_kwargs)[source]¶
Return urllib3 ProxyManager for the given proxy.
This method should not be called from user code, and is onlyexposed for use when subclassing the
HTTPAdapter.- Parameters:
proxy – The proxy to return a urllib3 ProxyManager for.
proxy_kwargs – Extra keyword arguments used to configure the Proxy Manager.
- Returns:
ProxyManager
- Return type:
- request_url(request,proxies)[source]¶
Obtain the url to use when making the final request.
If the message is being sent through a HTTP proxy, the full URL has tobe used. Otherwise, we should only use the path portion of the URL.
This should not be called from user code, and is only exposed for usewhen subclassing the
HTTPAdapter.- Parameters:
request – The
PreparedRequestbeing sent.proxies – A dictionary of schemes or schemes and hosts to proxy URLs.
- Return type:
- send(request,stream=False,timeout=None,verify=True,cert=None,proxies=None)[source]¶
Sends PreparedRequest object. Returns Response object.
- Parameters:
request – The
PreparedRequestbeing sent.stream – (optional) Whether to stream the request content.
timeout (float ortuple orurllib3 Timeout object) – (optional) How long to wait for the server to senddata before giving up, as a float, or a(connect timeout,read timeout) tuple.
verify – (optional) Either a boolean, in which case it controls whetherwe verify the server’s TLS certificate, or a string, in which case itmust be a path to a CA bundle to use
cert – (optional) Any user-provided SSL certificate to be trusted.
proxies – (optional) The proxies dictionary to apply to the request.
- Return type:
Authentication¶
- classrequests.auth.HTTPBasicAuth(username,password)[source]¶
Attaches HTTP Basic Authentication to the given Request object.
Encodings¶
- requests.utils.get_encodings_from_content(content)[source]¶
Returns encodings from given content string.
- Parameters:
content – bytestring to extract encodings from.
Cookies¶
- requests.utils.dict_from_cookiejar(cj)[source]¶
Returns a key/value dictionary from a CookieJar.
- Parameters:
cj – CookieJar object to extract cookies from.
- Return type:
- requests.utils.add_dict_to_cookiejar(cj,cookie_dict)[source]¶
Returns a CookieJar from a key/value dictionary.
- Parameters:
cj – CookieJar to insert cookies into.
cookie_dict – Dict of key/values to insert into CookieJar.
- Return type:
CookieJar
- requests.cookies.cookiejar_from_dict(cookie_dict,cookiejar=None,overwrite=True)[source]¶
Returns a CookieJar from a key/value dictionary.
- Parameters:
cookie_dict – Dict of key/values to insert into CookieJar.
cookiejar – (optional) A cookiejar to add the cookies to.
overwrite – (optional) If False, will not replace cookiesalready in the jar with new ones.
- Return type:
CookieJar
- classrequests.cookies.RequestsCookieJar(policy=None)[source]¶
Compatibility class; is a http.cookiejar.CookieJar, but exposes a dictinterface.
This is the CookieJar we create by default for requests and sessions thatdon’t specify one, since some clients may expect response.cookies andsession.cookies to support dict operations.
Requests does not use the dict interface internally; it’s just forcompatibility with external client code. All requests code should workout of the box with externally provided instances of
CookieJar, e.g.LWPCookieJarandFileCookieJar.Unlike a regular CookieJar, this class is pickleable.
Warning
dictionary operations that are normally O(1) may be O(n).
- add_cookie_header(request)¶
Add correct Cookie: header to request (urllib.request.Request object).
The Cookie2 header is also added unless policy.hide_cookie2 is true.
- clear(domain=None,path=None,name=None)¶
Clear some cookies.
Invoking this method without arguments will clear all cookies. Ifgiven a single argument, only cookies belonging to that domain will beremoved. If given two arguments, cookies belonging to the specifiedpath within that domain are removed. If given three arguments, thenthe cookie with the specified name, path and domain is removed.
Raises KeyError if no matching cookie exists.
- clear_expired_cookies()¶
Discard all expired cookies.
You probably don’t need to call this method: expired cookies are neversent back to the server (provided you’re using DefaultCookiePolicy),this method is called by CookieJar itself every so often, and the.save() method won’t save expired cookies anyway (unless you askotherwise by passing a true ignore_expires argument).
- clear_session_cookies()¶
Discard all session cookies.
Note that the .save() method won’t save session cookies anyway, unlessyou ask otherwise by passing a true ignore_discard argument.
- extract_cookies(response,request)¶
Extract cookies from response, where allowable given the request.
- get(name,default=None,domain=None,path=None)[source]¶
Dict-like get() that also supports optional domain and path args inorder to resolve naming collisions from using one cookie jar overmultiple domains.
Warning
operation is O(n), not O(1).
- get_dict(domain=None,path=None)[source]¶
Takes as an argument an optional domain and path and returns a plainold Python dict of name-value pairs of cookies that meet therequirements.
- Return type:
- items()[source]¶
Dict-like items() that returns a list of name-value tuples from thejar. Allows client-code to call
dict(RequestsCookieJar)and get avanilla python dict of key value pairs.See also
keys() and values().
- iteritems()[source]¶
Dict-like iteritems() that returns an iterator of name-value tuplesfrom the jar.
See also
iterkeys() and itervalues().
- iterkeys()[source]¶
Dict-like iterkeys() that returns an iterator of names of cookiesfrom the jar.
See also
itervalues() and iteritems().
- itervalues()[source]¶
Dict-like itervalues() that returns an iterator of values of cookiesfrom the jar.
See also
iterkeys() and iteritems().
- keys()[source]¶
Dict-like keys() that returns a list of names of cookies from thejar.
See also
values() and items().
- make_cookies(response,request)¶
Return sequence of Cookie objects extracted from response object.
- multiple_domains()[source]¶
Returns True if there are multiple domains in the jar.Returns False otherwise.
- Return type:
- pop(k[,d])→v,removespecifiedkeyandreturnthecorrespondingvalue.¶
If key is not found, d is returned if given, otherwise KeyError is raised.
- popitem()→(k,v),removeandreturnsome(key,value)pair¶
as a 2-tuple; but raise KeyError if D is empty.
- set(name,value,**kwargs)[source]¶
Dict-like set() that also supports optional domain and path args inorder to resolve naming collisions from using one cookie jar overmultiple domains.
- set_cookie(cookie,*args,**kwargs)[source]¶
Set a cookie, without checking whether or not it should be set.
- set_cookie_if_ok(cookie,request)¶
Set a cookie if policy says it’s OK to do so.
- setdefault(k[,d])→D.get(k,d),alsosetD[k]=difknotinD¶
- classrequests.cookies.CookieConflictError[source]¶
There are two cookies that meet the criteria specified in the cookie jar.Use .get and .set and include domain and path args in order to be more specific.
- add_note()¶
Exception.add_note(note) –add a note to the exception
- with_traceback()¶
Exception.with_traceback(tb) –set self.__traceback__ to tb and return self.
Status Code Lookup¶
- requests.codes¶
alias of {}
Thecodes object defines a mapping from common names for HTTP statusesto their numerical codes, accessible either as attributes or as dictionaryitems.
Example:
>>>importrequests>>>requests.codes['temporary_redirect']307>>>requests.codes.teapot418>>>requests.codes['\o/']200
Some codes have multiple names, and both upper- and lower-case versions ofthe names are allowed. For example,codes.ok,codes.OK, andcodes.okay all correspond to the HTTP status code 200.
100:
continue101:
switching_protocols102:
processing,early-hints103:
checkpoint122:
uri_too_long,request_uri_too_long200:
ok,okay,all_ok,all_okay,all_good,\o/,✓201:
created202:
accepted203:
non_authoritative_info,non_authoritative_information204:
no_content205:
reset_content,reset206:
partial_content,partial207:
multi_status,multiple_status,multi_stati,multiple_stati208:
already_reported226:
im_used300:
multiple_choices301:
moved_permanently,moved,\o-302:
found303:
see_other,other304:
not_modified305:
use_proxy306:
switch_proxy307:
temporary_redirect,temporary_moved,temporary308:
permanent_redirect,resume_incomplete,resume400:
bad_request,bad401:
unauthorized402:
payment_required,payment403:
forbidden404:
not_found,-o-405:
method_not_allowed,not_allowed406:
not_acceptable407:
proxy_authentication_required,proxy_auth,proxy_authentication408:
request_timeout,timeout409:
conflict410:
gone411:
length_required412:
precondition_failed,precondition413:
request_entity_too_large,content_too_large414:
request_uri_too_large,uri_too_long415:
unsupported_media_type,unsupported_media,media_type416:
requested_range_not_satisfiable,requested_range,range_not_satisfiable417:
expectation_failed418:
im_a_teapot,teapot,i_am_a_teapot421:
misdirected_request422:
unprocessable_entity,unprocessable,unprocessable_content423:
locked424:
failed_dependency,dependency425:
unordered_collection,unordered,too_early426:
upgrade_required,upgrade428:
precondition_required,precondition429:
too_many_requests,too_many431:
header_fields_too_large,fields_too_large444:
no_response,none449:
retry_with,retry450:
blocked_by_windows_parental_controls,parental_controls451:
unavailable_for_legal_reasons,legal_reasons499:
client_closed_request500:
internal_server_error,server_error,/o\,✗501:
not_implemented502:
bad_gateway503:
service_unavailable,unavailable504:
gateway_timeout505:
http_version_not_supported,http_version506:
variant_also_negotiates507:
insufficient_storage509:
bandwidth_limit_exceeded,bandwidth510:
not_extended511:
network_authentication_required,network_auth,network_authentication
Migrating to 1.x¶
This section details the main differences between 0.x and 1.x and is meantto ease the pain of upgrading.
API Changes¶
Response.jsonis now a callable and not a property of a response.importrequestsr=requests.get('https://api.github.com/events')r.json()# This *call* raises an exception if JSON decoding fails
The
SessionAPI has changed. Sessions objects no longer take parameters.Sessionis also now capitalized, but it can still beinstantiated with a lowercasesessionfor backwards compatibility.s=requests.Session()# formerly, session took parameterss.auth=auths.headers.update(headers)r=s.get('https://httpbin.org/headers')
All request hooks have been removed except ‘response’.
Authentication helpers have been broken out into separate modules. Seerequests-oauthlib andrequests-kerberos.
The parameter for streaming requests was changed from
prefetchtostreamand the logic was inverted. In addition,streamis nowrequired for raw response reading.# in 0.x, passing prefetch=False would accomplish the same thingr=requests.get('https://api.github.com/events',stream=True)forchunkinr.iter_content(8192):...
The
configparameter to the requests method has been removed. Some ofthese options are now configured on aSessionsuch as keep-alive andmaximum number of redirects. The verbosity option should be handled byconfiguring logging.importrequestsimportlogging# Enabling debugging at http.client level (requests->urllib3->http.client)# you will see the REQUEST, including HEADERS and DATA, and RESPONSE with HEADERS but without DATA.# the only thing missing will be the response.body which is not logged.try:# for Python 3fromhttp.clientimportHTTPConnectionexceptImportError:fromhttplibimportHTTPConnectionHTTPConnection.debuglevel=1logging.basicConfig()# you need to initialize logging, otherwise you will not see anything from requestslogging.getLogger().setLevel(logging.DEBUG)requests_log=logging.getLogger("urllib3")requests_log.setLevel(logging.DEBUG)requests_log.propagate=Truerequests.get('https://httpbin.org/headers')
Licensing¶
One key difference that has nothing to do with the API is a change in thelicense from theISC license to theApache 2.0 license. The Apache 2.0license ensures that contributions to Requests are also covered by the Apache2.0 license.
Migrating to 2.x¶
Compared with the 1.0 release, there were relatively few backwardsincompatible changes, but there are still a few issues to be aware of withthis major release.
For more details on the changes in this release including new APIs, linksto the relevant GitHub issues and some of the bug fixes, read Cory’sblogon the subject.
API Changes¶
There were a couple changes to how Requests handles exceptions.
RequestExceptionis now a subclass ofIOErrorrather thanRuntimeErroras that more accurately categorizes the type of error.In addition, an invalid URL escape sequence now raises a subclass ofRequestExceptionrather than aValueError.requests.get('http://%zz/')# raises requests.exceptions.InvalidURL
Lastly,
httplib.IncompleteReadexceptions caused by incorrect chunkedencoding will now raise a RequestsChunkedEncodingErrorinstead.The proxy API has changed slightly. The scheme for a proxy URL is nowrequired.
proxies={"http":"10.10.1.10:3128",# use http://10.10.1.10:3128 instead}# In requests 1.x, this was legal, in requests 2.x,# this raises requests.exceptions.MissingSchemarequests.get("http://example.org",proxies=proxies)
Behavioural Changes¶
Keys in the
headersdictionary are now native strings on all Pythonversions, i.e. bytestrings on Python 2 and unicode on Python 3. If thekeys are not native strings (unicode on Python 2 or bytestrings on Python 3)they will be converted to the native string type assuming UTF-8 encoding.Values in the
headersdictionary should always be strings. This hasbeen the project’s position since before 1.0 but a recent change(since version 2.11.0) enforces this more strictly. It’s advised to avoidpassing header values as unicode when possible.