Repository files navigation

Deep Learning components for extending PyTorch Lightning

---

Installation •Latest Docs •Stable Docs •About •Community •Website •License

Pip / Conda

pip install lightning-bolts

pip install https://github.com/Lightning-Universe/lightning-bolts/archive/refs/heads/master.zip

pip install lightning-bolts["extra"]

Bolts package provides a variety of components to extend PyTorch Lightning, such as callbacks & datasets, for applied research and production.

Torch ORT converts your model into an optimized ONNX graph, speeding up training & inference when using NVIDIA or AMD GPUs. See thedocumentation for more details.

frompytorch_lightningimportLightningModule,Trainerimporttorchvision.modelsasmodelsfrompl_bolts.callbacksimportORTCallbackclassVisionModel(LightningModule):def__init__(self):super().__init__()self.model=models.vgg19_bn(pretrained=True)    ...model=VisionModel()trainer=Trainer(gpus=1,callbacks=ORTCallback())trainer.fit(model)

We can introduce sparsity during fine-tuning withSparseML, which ultimately allows us to leverage theDeepSparse engine to see performance improvements at inference time.

frompytorch_lightningimportLightningModule,Trainerimporttorchvision.modelsasmodelsfrompl_bolts.callbacksimportSparseMLCallbackclassVisionModel(LightningModule):def__init__(self):super().__init__()self.model=models.vgg19_bn(pretrained=True)    ...model=VisionModel()trainer=Trainer(gpus=1,callbacks=SparseMLCallback(recipe_path="recipe.yaml"))trainer.fit(model)

We'd like to encourage users to contribute general components that will help a broad range of problems; however, components that help specific domains will also be welcomed!

For example, a callback to help train SSL models would be a great contribution; however, the next greatest SSL model from your latest paper would be a good contribution toLightning Flash.

UseLightning Flash to train, predict and serve state-of-the-art models for applied research. We suggest looking at ourVISSL Flash integration for SSL-based tasks.

Bolts is supported by the PyTorch Lightning team and the PyTorch Lightning community!

Join our Slack and/or read ourCONTRIBUTING guidelines to get help becoming a contributor!

Please observe the Apache 2.0 license that is listed in this repository.In addition, the Lightning framework is Patent Pending.