Skip to content

Commit

Permalink
Merge pull request #30 from neuralmagic/akamai-flows
Browse files Browse the repository at this point in the history
Add Akamai user flows
  • Loading branch information
mgoin authored Apr 11, 2024
2 parents 3a61d8b + 9751054 commit fb9b614
Show file tree
Hide file tree
Showing 8 changed files with 20,489 additions and 0 deletions.
5 changes: 5 additions & 0 deletions .github/workflows/mlc-config.json
Original file line number Diff line number Diff line change
@@ -1,4 +1,9 @@
{
"aliveStatusCodes": [
0,
200,
403,
],
"ignorePatterns": [
{
"pattern": ".*localhost.*"
Expand Down
38 changes: 38 additions & 0 deletions demos/akamai-user-flows/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
# Neural Magic SparseML and DeepSparse Flows for Akamai Cloud Platforms

This README provides an overview of the available tutorials and guides for optimizing and deploying models using Neural Magic's tools.

## Tutorials

### 1. YOLOv8 Object Detection: Sparse Transfer Learning

Learn how to fine-tune a pre-sparsified YOLOv8 model using SparseML's CLI, export it to ONNX, and deploy it with DeepSparse for efficient object detection inference.

[Read the tutorial](docs_object_detection_python_yolov8_sparse_transfer.md)

### 2. Sentiment Analysis: Sparse Transfer Learning with the Python API

Discover how to fine-tune a 90% pruned BERT model on the Rotten Tomatoes dataset using SparseML's Hugging Face Integration, apply model distillation, export to ONNX, and deploy with DeepSparse.

[Read the tutorial](docs_sentiment_analysis_python_custom_teacher_rottentomatoes.md)

### 3. Optimizing LLMs with One-Shot Pruning and Quantization

Explore techniques for optimizing large language models (LLMs) using sparsification and quantization. Learn how to apply one-shot compression to the TinyLlama chat model, evaluate its performance, export to ONNX, and deploy with DeepSparse.

[Read the tutorial](docs_text_generation_python_tinyllama_oneshot_compression.md)

## Getting Started

To get started with these tutorials, make sure you have the following prerequisites:

- A system that meets the minimum hardware and software requirements as outlined in the [Install Guide](https://docs.neuralmagic.com/get-started/install/#prerequisites).
- Python 3.8 or higher installed.
- Neural Magic's SparseML and DeepSparse libraries installed.

For detailed installation instructions and requirements, please refer to the individual tutorial pages.
## Support

If you encounter any issues or have questions related to these tutorials, please reach out to our support team at [email protected] or join our [Slack community](https://join.slack.com/t/discuss-neuralmagic/shared_invite/zt-q1a1cnvo-YBoICSIw3L1dmQpjBeDurQ).

Happy learning and optimizing!

Large diffs are not rendered by default.

Loading

0 comments on commit fb9b614

Please sign in to comment.