Oracle is a project designed to provide a convenient solution for downloading and transcribing YouTube videos. It utilizes the yt-dlp tool for video downloads and Faster-Whisper for transcription. The project is developed using Python and Conda, with the objective of ensuring compatibility with both Windows and Linux operating systems.
The project comprises three distinct components:
YouTube Downloader: Found inside the "youtube" folder, this module facilitates easy downloading of YouTube videos.
Transcriber (Whisper): Located in the "transcribe" folder, this module offers seamless transcription functionality using Faster-Whisper.
The primary goal of Oracle is to create a modular framework that streamlines the process of downloading YouTube videos and transcribing their contents. It leverages Conda to create a virtual environment and relies on Python 3.11 for its implementation.
Each component of the project is accompanied by a detailed README.md file, providing step-by-step instructions for installation and usage. It is important to note that all modules require the prior installation and configuration of Conda.
To begin using Oracle, please ensure Conda is installed and configured on your system. You can download and install Conda from this link: Conda Installation Guide
Wishing you the best of luck and a delightful experience with Oracle!
Because we are using Conda, its good to install and prepare the environment for the project.
conda create -n oracle python=3.11Activate the environment
conda activate oracleWell, its up to you :D. Start with the project module you desire and follow the instructions. If you have any questions, feel free to ask me. You can also combine them into your pipeline thingy :D.
What I have done is to create an single conda environment and then install all of the modules into that environment. You can also use the project as an template for your own project. Have fun and enjoy.
Source: https://github.com/yt-dlp/yt-dlp
As the project name implies, its a youtube downloader. The project is using yt-dlp to download youtube videos. The project is using Python and Conda. The step of the project is to get it to work in Windows and then Linux.
Primary Source: https://github.com/Purfview/whisper-standalone-win
Secondary Source: https://github.com/guillaumekln/faster-whisper
The project is using Faster-Whisper to transcribe the downloaded youtube videos. The project is using Python and Conda. The step of the project is to get it to work in Windows and then Linux.
Source: https://github.com/FFmpeg/FFmpeg
The project is using FFmpeg to convert the downloaded youtube videos to different formats, my project just converts them into mp3 for later transcription.
Many thanks for the open source community for making this project possible. Also thanks Tay, Chad and Data for the support during the development of this project.
Future development of the project.
- Basic Modules (youtube, transcribe, ffmpeg)
- Implement DB (MongoDB)
- Research, Education, Development
- Implement data ingestion
- Vector Storage
- Research, Education, Development
- Implement data ingestion
- Implement GUI
- Research, Education, Development
- Implement solution