Authentication Methods across Hadoop projects

Let us review the authentication methods used across Hadoop related projects. You can see that most products support Kerberos. Majority supports  LDAP as well.  Most products enable you to plugin your own custom authentication.

Here is the catalog of projects and authentication methods. If I missed some projects, please let me know and I will add it here.

ProductProtocolSupported methodsFramework Comments
HadoopRPCKerberosSASLIn addition, hadoop supports simple authentication. But this is not a real authentication scheme.
HadoopHTTPSpnego (Kerberos),
LDAP
Custom
HadoopAuthIn addition, hadoop supports psuedo authentication.
HiveServer2ThriftKerberos,
LDAP
SASL
OozieHTTPKerberos,
LDAP
Custom
HadoopAuth
HBaseRPCKerberos
SASL
HBaseHTTPSpnego (Kerberos),
LDAP
HadoopAuth
ZeppelinHTTPLDAP,
Kerberos
JDBC
Custom
Apache Shiro
Cloudera LivyHTTPKerberosSASL
cloudera HueHTTPspnego
LDAP
SSO (token based)
KnoxHTTPSpnego
LDAP
SAML
OAuth
HadoopAuth
Custom
KafkaKerberos
TLS
Custom
SASL
KylinHTTPLDAP
SSO SAML
Spring security

You May Also Like

About the Author: Benoy Antony

I am an Apache Hadoop Committer and has been working as an engineer/architect at companies like eBay and Paypal. Please check my LinkedIn Profile for the full profile.

Leave a Reply

Your email address will not be published. Required fields are marked *

Bitnami