MPLogger
Multi-processing capable print-like logger for Python
Requirements and Installation
Python 3.8+ is required
Pip
pip install mplogger
Manual
Poetry and (optionally) GNU Make are required.
git clone https://github.com/ELTE-DH/webarticlecurator.git- Run
make
On Windows or without Make (after cloning the repository):
poetry install --no-rootpoetry buildpoetry run pip install --upgrade dist/*.whl(the correct filename must be specified on Windows)
Usage
Single-process
from MLPlogger import Logger
# Initialize logger (default: STDERR only with INFO level)
logger = Logger(log_filename, logfile_mode, logfile_encoding, logfile_level, console_stream, console_level, console_format, file_format)
logger.log('INFO', 'First argument log level as string')
logger.log('WARNING', 'THIS IS A WARNING!', 'In multiple lines', 'just like print()', sep='\n')
logger.log('CRITICAL', 'Can also set line endings!', end='\r\n')
Multi-process
from itertools import repeat
from multiprocessing import Pool, Manager, current_process
from MLPlogger import Logger
def worker_process(par):
state, lq = par
retl = []
for n in range(100):
lq.log('WARNING', f'{current_process().name} message{state} {n}')
lq.log('WARNING', f'{current_process().name} finished')
return retl
log_obj = Logger('test.log', 'w') # Apply all parameters for logger here!
log_obj.log('INFO', 'NORMAL LOG BEGIN') # Normal logging
with Manager() as man:
log_queue = man.Queue()
with log_obj.init_mp_logging_context(log_queue) as mplogger, Pool() as p:
# Here one can log parallel from all processes!
return_queue = p.imap(worker_process, zip(range(10), repeat(mplogger)), chunksize=3)
for _ in return_queue:
pass
log_obj.log('INFO', 'NORMAL LOG END') # Normal logging
Licence
This project is licensed under the terms of the GNU LGPL 3.0 license.
2 Oct 2, 2022
3 Jan 10, 2022
1.5k Jan 6, 2023
365 Nov 11, 2022
43 Dec 27, 2022
17 Jul 17, 2022
795 Dec 18, 2022
13.7k Jan 2, 2023
1.4k Dec 31, 2022
5 May 02, 2022
45 Sep 25, 2022
778 Dec 26, 2022
5 Apr 01, 2022
102 Dec 22, 2022
496 Dec 30, 2022
15 Dec 29, 2022
3 Mar 28, 2022
7.3k Jan 01, 2023
1 Feb 25, 2022
1 Nov 10, 2021
924 Jan 05, 2023
1 Feb 13, 2022
0 May 24, 2022
23 Oct 04, 2021
38 Jul 20, 2022
3.9k Jan 03, 2023
824 Jan 08, 2023