Modules ∞
Common tools used thoughout the fundamentals package |
|
Tools used to perform download of files and HTML pages from the web |
|
Tools for working with files and folders |
|
Some handy mysql database query and insertion tools |
|
plugins for nose2 unit testing |
|
*Render python objects as various list and markup formats * |
|
Some reusable statistic functions |
|
Logger setup for python projects |
|
Some time functions to be used with logging etc |
Classes ∞
A class to daemonise a python code |
|
The fileChunker iterator - iterate over large line-based files to reduce memory footprint |
|
rotating file handler for logging |
|
A fake logger object so user can set ``log=False`` if required |
|
a database object that can setup up a ssh tunnel (optional) and a database connection |
|
Take a sqlite database file and copy the tables within it to a MySQL database |
|
Take key-values from yaml files including a tablename(s) and add them to a mysql database table |
|
*The dataset object is a list of python dictionaries. |
|
common setup methods & attributes of the main function in cl-util |
|
Default setup for fundamentals style unit-testing workflow (all tests base on nose module) |
Functions ∞
Get the root path for this python package |
|
append the current datestamp to the end of the filename (before the extension). |
|
get the filename from a URL. |
|
A datetime stamp to be appended to the end of filenames: ‘YYYYMMDDtHHMMSS’ |
|
get multiple url documents and place them in specified download directory/directories |
|
Convert a python list of dictionaries to pretty csv output |
|
list directory contents recursively. |
|
Add tags and ratings to your macOS files and folders |
|
multiprocess pool |
|
Setup and return a console logger |
|
setup dryx style python logging |
|
convert dictionary to mysql table |
|
A function to run all mysql scripts in a given directory (in a modified date order, oldest first) and then act on the script files in accordance with the succcess or failure of their execution |
|
get database table column names |
|
|
insert list of dictionaries into database tables |
Given a mysql query, read the data from the database and return the results as a list of dictionaries (database rows) |
|
Start a database connection using settings in yaml file |
|
Probe a database to determine if a given table exists |
|
Execute a MySQL write command given a sql query |
|
given a sorted list of values, median sigma-clip values based on a window of values either side of each value (rolling window) and return the array mask |
|
Return the time difference between two dates as a string |
|
*convert date to a relative datetime (e.g. |
|
A datetime stamp in MySQL format: ‘YYYY-MM-DDTHH:MM:SS’ |