Git repo link : https://github.com/lserinol/Hive-udfs
Hive-udfs
Collection of my Scala Hive UDFs
Requirements
- SBT
- Scala
- Hive
Compile
- git clone/fork project https://github.com/lserinol/Hive-udfs.git
- sbt assembly
- add jar 'target/scala-version number/levent-hive-funcs-assembly-version number.jar' to HIVE_AUX_JARS_FILE_PATH
or use "add jar" command for Hive-CLI/Beeline
Registering UDFs
create temporary function lcrc32 as 'com.levent.hive.udfs.lcrc32';
create temporary function ldays_between as 'com.levent.hive.udfs.ldays_between';
create temporary function lmonths_between as 'com.levent.hive.udfs.lmonths_between';
create temporary function ilike as 'com.levent.hive.udfs.liLIKE';
create temporary function ldays_between as 'com.levent.hive.udfs.ldays_between';
create temporary function lmonths_between as 'com.levent.hive.udfs.lmonths_between';
create temporary function ilike as 'com.levent.hive.udfs.liLIKE';
com.levent.hive.udfs.lcrc32
- takes a string input and returns crc32(long) value
com.levent.hive.udfs.ldays_between
- calculates days difference between two dates and returns number of days(int) value
com.levent.hive.udfs.lmonths_between
- calculates months difference between two dates and returns number of months(int) value
com.levent.hive.udfs.liLIKE
- Hive ilike function in-case sensitive like between two strings retuns boolean TRUE/FALSE
No comments:
Post a Comment