๋ฐ์ํ
250x250
Notice
Recent Posts
Recent Comments
Link
| ์ผ | ์ | ํ | ์ | ๋ชฉ | ๊ธ | ํ |
|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | |||
| 5 | 6 | 7 | 8 | 9 | 10 | 11 |
| 12 | 13 | 14 | 15 | 16 | 17 | 18 |
| 19 | 20 | 21 | 22 | 23 | 24 | 25 |
| 26 | 27 | 28 | 29 | 30 | 31 |
Tags
- BIGDATA
- rpmbuild
- LeetCode
- aws ccp
- ๋ฆฌ๋ ์ค RPM
- ๋ฆฟ์ฝ๋
- HBase
- ์คํํฌ
- hadoop
- elastic stack
- ๋ฆฌ๋ ์ค
- Apache spark
- ํ๋ก์ค์น
- ansible
- standalone
- ํ๋ก
- ํ๋ก์์ฝ์์คํ
- ์ค์นผ๋ผ ๋ถ
- ์ค์๋ธ ์ค์น
- ์ํ์น ์คํํฌ
- CLF-C02
- airflow
- kudu
- ๋ฐ์ดํฐ๋ถ์์ค์ ๋ฌธ๊ฐ
- ์ค์๋ธ
- ์ฑ๊ธ์๋ฒ
- ํด ์ค์น
- ํ์ด๋ธ
- ๋น ๋ฐ์ดํฐ
- ์๋ผ์คํฑ์์น
Archives
- Today
- Total
data_lab
[airflow] airflow ์ค์น ํ ์คํ ๋ณธ๋ฌธ
Airflow ์ค์น ํ ์คํ
nohup airflow webserver--port 8080 > webserver.log 2>&1 &Airflow Scheduler ์คํ
nohup airflow scheduler > scheduler.log 2>&1 &Aiflow DAG ๋ฆฌ์คํธ ํ์ธ
airflow dags list์คํ ํ ๊ฒฐ๊ณผ
dag_id | filepath | owner | paused
==============================+===============================+=========+=======
example_bash_operator | /usr/local/lib/python3.7/site | airflow | False
| -packages/airflow/example_dag | |
| s/example_bash_operator.py | |
example_branch_datetime_opera | /usr/local/lib/python3.7/site | airflow | True
tor_2 | -packages/airflow/example_dag | |
| s/example_branch_datetime_ope | |
| rator.py | |
example_branch_dop_operator_v | /usr/local/lib/python3.7/site | airflow | True
3 | -packages/airflow/example_dag | |
| s/example_branch_python_dop_o | |
| perator_3.py | |
example_branch_labels | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_branch_labels.py | |
example_branch_operator | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_branch_operator.py | |
example_complex | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_complex.py | |
example_dag_decorator | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_dag_decorator.py | |
example_external_task_marker_ | /usr/local/lib/python3.7/site | airflow | True
child | -packages/airflow/example_dag | |
| s/example_external_task_marke | |
| r_dag.py | |
example_external_task_marker_ | /usr/local/lib/python3.7/site | airflow | True
parent | -packages/airflow/example_dag | |
| s/example_external_task_marke | |
| r_dag.py | |
example_nested_branch_dag | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_nested_branch_dag.p | |
| y | |
example_passing_params_via_te | /usr/local/lib/python3.7/site | airflow | True
st_command | -packages/airflow/example_dag | |
| s/example_passing_params_via_ | |
| test_command.py | |
example_python_operator | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_python_operator.py | |
example_short_circuit_operato | /usr/local/lib/python3.7/site | airflow | True
r | -packages/airflow/example_dag | |
| s/example_short_circuit_opera | |
| tor.py | |
example_skip_dag | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_skip_dag.py | |
example_sla_dag | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_sla_dag.py | |
example_subdag_operator | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_subdag_operator.py | |
example_subdag_operator.secti | /usr/local/lib/python3.7/site | airflow | True
on-1 | -packages/airflow/example_dag | |
| s/example_subdag_operator.py | |
example_subdag_operator.secti | /usr/local/lib/python3.7/site | airflow | True
on-2 | -packages/airflow/example_dag | |
| s/example_subdag_operator.py | |
example_task_group | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_task_group.py | |
example_task_group_decorator | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_task_group_decorato | |
| r.py | |
example_time_delta_sensor_asy | /usr/local/lib/python3.7/site | airflow | True
nc | -packages/airflow/example_dag | |
| s/example_time_delta_sensor_a | |
| sync.py | |
example_trigger_controller_da | /usr/local/lib/python3.7/site | airflow | True
g | -packages/airflow/example_dag | |
| s/example_trigger_controller_ | |
| dag.py | |
example_trigger_target_dag | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_trigger_target_dag. | |
| py | |
example_weekday_branch_operat | /usr/local/lib/python3.7/site | airflow | True
or | -packages/airflow/example_dag | |
| s/example_branch_day_of_week_ | |
| operator.py | |
example_xcom | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_xcom.py | |
example_xcom_args | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_xcomargs.py | |
example_xcom_args_with_operat | /usr/local/lib/python3.7/site | airflow | True
ors | -packages/airflow/example_dag | |
| s/example_xcomargs.py | |
latest_only | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_latest_only.py | |
latest_only_with_trigger | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/example_latest_only_with_tr | |
| igger.py | |
tutorial | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/tutorial.py | |
tutorial_etl_dag | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/tutorial_etl_dag.py | |
tutorial_taskflow_api_etl | /usr/local/lib/python3.7/site | airflow | True
| -packages/airflow/example_dag | |
| s/tutorial_taskflow_api_etl.p | |
| y | |
tutorial_taskflow_api_etl_vir | /usr/local/lib/python3.7/site | airflow | True
tualenv | -packages/airflow/example_dag | |
| s/tutorial_taskflow_api_etl_v | |
| irtualenv.py์์๋ก ๋ค์ด ์๋ airflow dags ์์น ์์ ์๋ค.
728x90
๋ฐ์ํ
'BIGDATA > ํ๋ก์์ฝ์์คํ ' ์นดํ ๊ณ ๋ฆฌ์ ๋ค๋ฅธ ๊ธ
| Imapa VS Hive (0) | 2022.03.30 |
|---|---|
| [kudu] kudu cluster๋ชจ๋๋ก ์คํ (0) | 2022.03.29 |
| [Hive] ์ด๊ธฐ ๋ฐ์ดํฐ๋ฒ ์ด์ค ์ฐ๋ ํ ์๊ธฐ๋ ํ ์ด๋ธ ๋ชฉ๋ก (0) | 2022.03.04 |
| [kudu] apache kudu ๋ (23.12.01 ์์ ) (0) | 2021.12.14 |
| [Apache NiFi] ์ํ์น ๋์ดํ์ด ๋? (0) | 2021.12.06 |
'BIGDATA/ํ๋ก์์ฝ์์คํ
' Related Articles
more
