Apache pig installation for Mac & Linux

2014-04-04, Friday

hadoop pig

Apache pig local clinet安裝教學 (Mac & Linux 適用)
安裝java.(jdk 1.6以上版本).

設定JAVA_HOME
ps.如果你已經安裝java,可以透過以下的command找尋安裝目錄

1
2
3


On Linux you can run $(dirname $(dirname $(readlink $(which javac))))

On Mac you can run $(dirname $(readlink $(which javac)))/java_home

sample:
export JAVA_HOME=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/
下載pig.
download_pig
本次使用最新版pig-0.12.0
(你可以選擇src自己編譯或是直接下載編譯好的tar files.我是直接選擇編譯好的檔案)

tar -xvf pig-0.12.0.tar

cd pig-0.12.0/bin

export PATH=#{folder位置}/pig-0.12.0/bin:$PATH
tip:如果不想每次開機都執行一次設定參數可以將JAVA_HOME & PATH參數加入~/.bashrc 裡

pig -x local
(可以run 起來表示安裝成功,使用quit離開)

 1
 2
 3
 4
 5
 6
 7
 8
 9
10


echo "a
a
b" > test_source

echo "load_f = load 'test_source' using PigStorage as (atext:chararray);
group_text = group load_f by atext;
gen_res = foreach group_text generate group,COUNT(load_f);
dump gen_res" > word_count.pig

pig -x local word_count.pig

可能有興趣的文章:

Hadoop mapReduce on Ruby