Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Install/Configure Apache Airflow #964

Open
glaubervila opened this issue Apr 8, 2024 · 0 comments
Open

Install/Configure Apache Airflow #964

glaubervila opened this issue Apr 8, 2024 · 0 comments
Assignees
@glaubervila
Labels
feature A feature development.
Milestone
PH2-3B Solar Syst...

Comments

@glaubervila
Copy link
Contributor

glaubervila commented Apr 8, 2024 •
edited
Loading

Instalar e configurar o apache airflow para gerenciar os pipelines de dados do portal tno.
Exemplo de tarefas que podem ser otimizadas/gerenciadas pelo Airflow.

  • Download dados sobre o bsp do JPL ( consulta API )
  • Download do arquivo bsp do jpl ( Vai permitir a execução das predições para todo o sistema solar )
  • Atualização dos bsps quando houver alteração na data de observação.
  • Atualização da lista de asteroids
  • Geração dos mapas
  • Processamento e Envio das newsletters.
@glaubervila glaubervila added the feature A feature development. label Apr 8, 2024
@glaubervila glaubervila self-assigned this Apr 8, 2024
@github-project-automation github-project-automation bot moved this to 📋 Backlog in Software Apr 8, 2024
glaubervila added a commit that referenced this issue Apr 9, 2024
@glaubervila
AApache Airflow was integrated to manage recurring data pipeline tasks.
00676f0 
#964
glaubervila added a commit that referenced this issue Apr 9, 2024
@glaubervila
Example dags working correctly in the environment. Everything ready t…
5360bd1 
…o implement the portal's first DAG. #964
glaubervila added a commit that referenced this issue Apr 15, 2024
@glaubervila
Some dag prototypes were added for testing the airflow environment. #964
f33a25b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@glaubervila glaubervila

Labels
feature A feature development.
Projects
Software
Status: 📋 Backlog
Milestone
PH2-3B Solar System Expansion
Development

When branches are created from issues, their pull requests are automatically linked.

964-apache-airflow linea-it/tno
1 participant
@glaubervila