mgkit.net.utils module

Utility functions for the network package

mgkit.net.utils.url_open(url, data=None, headers=None, agent=None, get=True, stream=False)

Changed in version 0.3.4: now uses requests

Parameters:
  • url (str) – url to request
  • data (str) – parameters to pass to the request
  • headers (dict) – any additional headers
  • agent (str) – user agent to use
  • get (bool) – True if the request is a GET, False for POST
  • stream (bool) – returns an iterator to stream over
  • url – url to request
  • data – data to add to the request
  • compress (bool) – if the response should be compressed
  • agent – if supplied, the ‘User-Agent’ header we’ll be added to the request
Returns:

the response handle

mgkit.net.utils.url_read(url, data=None, agent=None, headers=None, get=True)

Changed in version 0.3.4: now uses requests, removed compressed and added headers, get

Opens an URL and reads the

Wrapper of url_open() which reads the full response

Parameters:
  • url (str) – url to request
  • data (dict or None) – data to add to the request
  • headers (dict or None) – additional headers
  • agent (str or None) – if supplied, the ‘User-Agent’ header we’ll be added to the request
  • get (bool) – uses a GET operation if True, POST if False
Returns:

the response data

Return type:

str