Repository files navigation

Theopencf-core package provides a robust framework for handling file conversion tasks in Python. It offers a set of classes and utilities designed to simplify the process of reading from and writing to different file formats efficiently.

• Modular Input/Output Handlers: Defines abstract base classes for file readers and writers, allowing for easy extension and customization.
• Support for Various File Formats: Provides built-in support for common file formats such as text, CSV, JSON, XML, Excel, and image files.
• MIME Type Detection: Includes a MIME type guesser utility to automatically detect the MIME type of files, facilitating seamless conversion based on file content.
• File Type Enumeration: Defines an enum for representing different file types, enabling easy validation and processing of input and output files.
• Exception Handling: Implements custom exceptions for handling errors related to unsupported file types, empty suffixes, file not found, and mismatches between file types.
• Base Converter Class: Offers an abstract base class for implementing specific file converters, providing a standardized interface for file conversion operations.
• Resolved Input File Representation: Introduces a class for representing input files with resolved file types, ensuring consistency and correctness in conversion tasks.

When using theopencf-core, you can adopt different strategies for file conversion based on your specific requirements:

In this approach, conversion is achieved without utilizing a dedicated writer. The reader module parses the input files into a list of objects. Subsequently, the_convert method orchestrates the writing process into a file or folder. This method is suitable for scenarios where direct manipulation of data structures suffices for conversion.

Conversely, indirect conversion employs a converter that supports a dedicated writer. Here, theconvert function's primary role is to transform the parsed list of objects into a format compatible with the writer. The actual conversion process may be executed by the writer, leveraging its capabilities. For instance, converting images to videos involves parsing images into a list of Pillow objects, which are then reformatted into a numpy array. This array, encapsulating frame dimensions and color channels, serves as input for the video writer.

The file conversion process can be dissected into three distinct instances:

• Reader: Handles input-output (IO) operations, transforming files into objects. Readers are implementations of the abstract classReader present inio_handler.py.

• Converter: Facilitates object-to-object conversion, acting as an intermediary for data transformation. Converters are implementations of the abstract classBaseConverter present inbase_converter.py.

• Writer (Optional): Reverses the IO process, converting objects back into files. Writers are implementations of the abstract classWriter present inio_handler.py.

• io_handler.py: Contains classes for reading from and writing to files, including text, CSV, JSON, XML, and image files. It includes abstract classes forReader andWriter.
• mimes.py: Provides a MIME type guesser utility for detecting file MIME types based on file content.
• filetypes.py: Defines enums and classes for representing different file types and handling file type validation.
• base_converter.py: Implements the base converter class and the resolved input file class for performing file conversion tasks. It includes theBaseConverter abstract class.

pip install opencf-core

Theopencf-core package can be used independently to build custom file conversion utilities or integrated into larger projects for handling file format transformations efficiently.

fromopencf_core.io_handlerimportCsvToListReader,ListToCsvWriterfromopencf_core.base_converterimportBaseConverter,ResolvedInputFilefromopencf_core.filetypesimportFileTypeclassCSVToJSONConverter(BaseConverter):file_reader=CsvToListReader()file_writer=DictToJsonWriter()@classmethoddef_get_supported_input_type(cls)->FileType:returnFileType.CSV@classmethoddef_get_supported_output_type(cls)->FileType:returnFileType.JSONdef_convert(self,input_path:Path,output_file:Path):# Implement conversion logic from CSV to JSONpass# Usageinput_file_path="input.csv"output_file_path="output.json"input_file=ResolvedInputFile(input_file_path,is_dir=False,should_exist=True)output_file=ResolvedInputFile(output_file_path,is_dir=False,should_exist=False,add_suffix=True)converter=CSVToJSONConverter(input_file,output_file)converter.convert()

Theexamples folder in this repository contains practical demonstrations of how to use theopencf-core package for file conversion tasks. Currently, it includes the following examples:

• simple_converter.py: Demonstrates a basic file converter that converts Excel (XLSX) files to CSV format. It utilizes theXLXSToCSVConverter class defined within theopencf-core package to perform the conversion.

• cli_app_example.py: Illustrates how to build a command-line interface (CLI) application using theConverterApp class from theopencf-core.converter_app module. This CLI app allows users to specify input and output files, as well as input and output file types, for performing file conversions.

These examples serve as practical demonstrations of how to leverage the capabilities of theopencf-core package in real-world scenarios. Users can refer to these examples for guidance on building their own file conversion utilities or integrating file conversion functionality into existing projects.

You can have a more practical insight by reading thesupport associated to the examples

• Introduce the concept of backend labeling forReader andWriter implementations.
• Enable multiple file readers/writers to share common backends. For instance, if anImageOpenCVReader utilizes both numpy and OpenCV, theVideoWriter can leverage the same dependencies.
• Allow users to specify preferred backend configurations, ensuring that conversion methods accommodate all selected backends seamlessly.

Contributions to theopencf-core package are welcome! Feel free to submit bug reports, feature requests, or pull requests via the GitHub repository.

Please note that while theopencf-core package aims to provide a versatile framework for file conversion tasks, it may not cover every possible use case or handle all edge cases. Users are encouraged to review and customize the code according to their specific requirements.