Content-Length: 292411 | pFad | http://github.com/apache/airflow/pull/25183/commits/1207916fd75148b6b74879786eedc0af7b6976da

0B Add auth_type to LivyHook by bdsoha · Pull Request #25183 · apache/airflow · GitHub
Skip to content

Add auth_type to LivyHook #25183

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
Aug 7, 2022
Merged
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Delegated auth_type to LivyOperator
  • Loading branch information
bdsoha authored Jul 21, 2022
commit 1207916fd75148b6b74879786eedc0af7b6976da
4 changes: 4 additions & 0 deletions airflow/providers/apache/livy/operators/livy.py
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@ class LivyOperator(BaseOperator):
:param conf: Spark configuration properties.
:param proxy_user: user to impersonate when running the job.
:param livy_conn_id: reference to a pre-defined Livy Connection.
:param livy_conn_auth_type: The auth type for the Livy Connection.
:param polling_interval: time in seconds between polling for job completion. Don't poll for values >=0
:param extra_options: A dictionary of options, where key is string and value
depends on the option that's being modified.
Expand Down Expand Up @@ -79,6 +80,7 @@ def __init__(
name: Optional[str] = None,
proxy_user: Optional[str] = None,
livy_conn_id: str = 'livy_default',
livy_conn_auth_type: Optional[Any] = None,
polling_interval: int = 0,
extra_options: Optional[Dict[str, Any]] = None,
extra_headers: Optional[Dict[str, Any]] = None,
Expand Down Expand Up @@ -108,6 +110,7 @@ def __init__(
}

self._livy_conn_id = livy_conn_id
self._livy_conn_auth_type = livy_conn_auth_type
self._polling_interval = polling_interval
self._extra_options = extra_options or {}
self._extra_headers = extra_headers or {}
Expand All @@ -128,6 +131,7 @@ def get_hook(self) -> LivyHook:
livy_conn_id=self._livy_conn_id,
extra_headers=self._extra_headers,
extra_options=self._extra_options,
livy_conn_auth_type=self._livy_conn_auth_type
)
return self._livy_hook

Expand Down








ApplySandwichStrip

pFad - (p)hone/(F)rame/(a)nonymizer/(d)eclutterfier!      Saves Data!


--- a PPN by Garber Painting Akron. With Image Size Reduction included!

Fetched URL: http://github.com/apache/airflow/pull/25183/commits/1207916fd75148b6b74879786eedc0af7b6976da

Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy