병렬분산알고리즘 기초 프로젝트

병렬분산알고리즘 기초

프로젝트 #1

src 디렉토리로 들어가 Driver.java 파일을 수정해줍니다.

Wordcount1char.java 도 수정해줍니다.

 

 

프로젝트 #2

Driver 파일 addClass 해주기

pgd.addClass("wordcountsort", Wordcountsort.class, "A map/reduce program that output frequency of the word in the input files by alphabetical order.");

1. import 시켜주기

import org.apache.hadoop.mapreduce.partitioner;

2. class 만들어주기

reduce 를 2개를 만들어줘야하기떄문에 기존에있던 리듀스 아래에 작성시켜줍니다.

    public static class MyPartitioner extends Partitioner<IntWritable,Text> {
    @Override
    public int getPartition(IntWritable key, Text value, int numPartitions){
    int nbOccurences = key.get();
    if( nbOccurences <=30) return 0;
    else return 1;
    }
}

3. 실행 시켜보기

 

hdfs dfs -cat wordcount_test_out/part-r-00000|more

 

hdfs dfs -cat wordcount_test_out/part-r-00001|more

hadoop@ubuntu:~/Project$ hdfs dfs -cat wordcount_test_out/part-r-00001|more
a    28
abolish    1
absolute    2
accidental    1
adversary,    1
again--not    1
against    2
age    1
aggression    1
ago.    1
alarmed    1
alike,    1
all    8
alliance    1
alliance,    1
allies    1
alter    1
always    4
an    2
ancient    1
and    30
anew    1
anew--remembering    1
answered    1
any    8
anywhere    1
are    8
are--    1
area    1
arms    2
arms,    1
arms--and    1
around    2
arts    1
as    6
ask    4
asking    1
assembly    1
assist    1
assure    2
asunder.    1
at    3
atom,    1
away    1
back    2
balance    2
battle,    1
be    7
beachhead    1
bear    3
because    3
become    1
becoming    1
been    4
before    2
begin    2
begin.    1
beginning--signifying    1
belaboring    1
belief    1
beliefs    1
believe    1
best    2
beyond    2
bitter    1
blessing    1
bonds    1
border,    1
both    9
break    1
bring    2
burden    1
burden,    1
burdens    1
but    8
by    7
call    4
can    8
cannot    4
casting    1
celebration    1
century    1
century,    1
certain    1
chains    1
challenge    1
change.    1
citizens    3
citizens,    1
civility    1
colonial    1
come    1
comfort    1
command    1
commerce.    1
committed    1
committed,    1
common    1
communists    1
conquer    1
conscience    1
control    3
convert    1
cooperation    1
cooperative    1
corners    1
cost    1
country    3
country.    1
course--both    1
course.    1
creating    1
cultural    1
danger.    1
dare    3
dark    1
days,    1
days.    1
deadly    1
deeds,    1
deeds--in    1
defending    1
depths    1
deserts,    1
destroy    1
destruction    1
devotion    1
different    1
disciplined    1
disease    1
disease,    1
divide    1
do    7
do--for    1
doing    1
doubt    2
each    1
earth    2
effort?    1
efforts    1
embattled    1
employed.    1
encourage    1
end    1
endeavor    1
endeavor,    1
ended    1
enemies    2
energy,    1
engulf    1
enlarge    1
eradicate    1
even    1
every    2
exchange    1
expect    1
explore    2
failure    1
faith,    1
faithful    1
far    2
fear    1
fear.    1
fellow    3
few    2
final    3
find    2
finished    2
fire    1
first    4
foe    2
foolishly    1
for    12
forbears    1
forebears    1
forge    1
forget    1
form    1
forms    2
formulate    1
forth    2
forum    1
fought    1
founded,    1
free    3
free,    1
free."    1
freedom    2
freedom--and    1
freedom--symbolizing    1
friend    1
friend,    1
friends.    1
from    7
fruitful    1
generation    2
generation.    1
generations    1
generosity    1
give    1
global    1
globe    1
globe--the    1
globe.    1
glow    1
go    3
good    3
governments    1
grand    1
granted    1
graves    1
great    1
groups    1
half    1
hand    2
hands    1
hands,    1
hard    1
hardship,    1
has    3
have    4
heavy    1
heed    1
heirs    1
help    3
help,    1
here    2
heritage--and    1
high    1
his    1
historic    1
history    2
holds    1
home    1
hope    3
hope,    1
host    1
hostile    1
hour    1
house.    1
human    3
humanity    1
hundred    1
huts    1
if    1
ill,    1
in    21
inside.    1
inspection    1
instead    2
instruments    2
intends    1
into    1
invective--to    1
invoke    1
iron    1
is    7
issue    1
it    5
it,    1
it--and    1
it.    1
its    6
itself.    1
join    3
judge    1
jungle    1
just    1
know    2
know,    1
knowing    1
land    1
last    1
law,    1
lead    1
let    8
liberty.    1
life    2
life.    1
lifetime    1
light    2
little    2
long    2
love,    1
loyalty    1
loyalty.    1
make    1
man    2
man.    1
man:    1
mankind's    1
mankind?    1
many    1
mass    1
master    1
maximum    1
may    3
meet    2
men    1
merely    2
mine,    1
misery,    1
modern    1
more    3
more.    1
mortal    1
much    1
must    1
my    2
nation    2
national    1
nations    3
nations.    1
nearly    1
need--not    1
negotiate    1
negotiate.    1
neighbors    1
neither    1
never    3
new    7
nor    2
not    16
now.    1
oath    1
observe    1
ocean    1
odds    1
of    66
off    1
offer    2
old    1
on    3
one    3
only    3
oppose    2
oppressed    1
or    7
origins    1
other    4
our    21
out    1
out,    1
outpaced    1
overburdened    1
own    2
own.    1
party    1
passed    2
past,    1
patient    1
pay    1
peace    1
peace,    3
peaceful    1
people    2
perhaps    1
period    1
permit    1
place,    1
places    1
planet.    1
planned    1
pledge    5
pledge--and    1
pledge--to    1
poor,    1
poverty    1
poverty,    1
poverty.    1
power    4
power,    1
powerful    2
powers    1
powers.    1
precise    1
prescribed    1
present    1
preserved.    1
prevent    1
prey    1
price,    1
problems    2
progress--to    1
proof.    1
proposals    1
proud    1
push    1
quest    1
racing    1
ranks    1
remain    1
remember    1
renew    1
renewal    1
replaced    1
republics    1
request:    1
required--not    1
responsibility--I    1
rest    1
revolution    1
revolution.    1
revolutionary    1
reward,    1
rich.    1
riding    1
right.    1
rightly    1
rights    2
role    1
run.    1
sacrifice    1
same    3
save    1
science    2
secure    1
seek    2
self-destruction.    1
serious    1
serve    1
service    1
shall    5
share,    1
shield    1
shrink    1
sides    7
sides,    1
sign    1
sincerity    1
sister    1
slow    1
so,    1
society    1
solemn    1
sought    1
south    1
sovereign    1
special    1
spiritual    1
split    1
spread    1
standards    1
stars,    1
state    1
states    1
states,    1
stays    1
steady    1
still    1
strength    1
strengthen    1
strong    1
strongly    1
struggle    1
struggle,    1
struggling    1
subject    1
subversion    1
success    2
sufficient    1
summoned    1
summons    1
support    1
support--to    1
supporting    2
sure    1
surround    1
survival    1
suspicion,    1
sworn    1
take    1
tap    1
tempered    1
tempt    1
terror    1
terrors.    1
testimony    1
than    1
that    19
that,    1
the    82
their    2
them    5
themselves    1
themselves,    1
there    2
these    1
they    1
this    11
those    7
though    2
thousand    1
three-quarters    1
tiger    1
time    1
time,    1
to    32
today    3
together    1
torch    1
tribulation"--a    1
truly    2
trumpet    1
twilight    1
two    1
tyranny,    1
tyranny.    1
uncertain    1
under    1
undoing    1
unite    2
unleashed    1
unwilling    1
up    1
us    11
us.    1
ventures.    1
very    1
victory    1
view.    1
villages    1
votes,    1
war    2
war,    1
war.    1
was    1
we    26
weak    1
weak--and    1
weakness,    1
weakness.    1
weapons,    1
welcome    2
well    3
what    5
whatever    1
when    1
where    2
whether    2
which    7
who    6
whom    1
whose    1
will    6
wishes    1
with    4
witness    1
wonders    1
word    2
words    1
work    1
world    3
world,    2
world.    2
world:    1
would    2
writ    1
year    2
yet    2
you    4
you,    1
you--ask    1
you.    1
young    1
your    3

프로젝트#3

InvertedIndex.java

package ssafy;

import java.io.IOException;
import java.util.StringTokenizer;

import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.io.LongWritable;
import org.apache.hadoop.mapreduce.Job;
import org.apache.hadoop.mapreduce.Mapper;
import org.apache.hadoop.mapreduce.Reducer;
import org.apache.hadoop.mapreduce.lib.input.FileSplit;
import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;
import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat;
import org.apache.hadoop.util.GenericOptionsParser;

public class InvertedIndex {
    /*
    Object, Text : input key-value pair type (always same (to get a line of input file))
    Text, IntWritable : output key-value pair type
    */
    public static class TokenizerMapper
            extends Mapper<Object,Text,Text,Text> {

    // variable declairations
    private final static IntWritable one = new IntWritable(1);
    private Text word = new Text();
    private Text pos = new Text();
    private String filename;
    protected void setup(Context context) throws IOException, InterruptedException {
        filename = ((FileSplit)context.getInputSplit()).getPath().getName();

    }

    // map function (Context -> fixed parameter)
    public void map(Object key, Text value, Context context)
            throws IOException, InterruptedException {

        // value.toString() : get a line
        StringTokenizer itr = new StringTokenizer(value.toString());
        long p = ((LongWritable)key).get();
        while ( itr.hasMoreTokens() ) {
            String token = itr.nextToken();
            word.set(token.trim());
            if (!token.equals(" ")) {
                pos.set(filename + ":" + p);
                context.write(word, pos);
            }
            p += token.length();
        }
    }
}

public static class ConcatenatorReducer extends Reducer<Text, Text, Text, Text> {

    private Text list = new Text();
    public void reduce(Text key, Iterable<Text> values, Context context) throws IOException, InterruptedException {
        String s = new String();
        int comma = 0;
        for (Text val: values) {
            if (comma == 0) {
                comma = 1;
                s += (":" + val.toString());
            }
            else {
                s += ("," + val.toString());
            }
        }
        list.set(s);
        context.write(key,list);

    }
}


/* Main function */
public static void main(String[] args) throws Exception {
    Configuration conf = new Configuration();
    String[] otherArgs = new GenericOptionsParser(conf,args).getRemainingArgs();
    if ( otherArgs.length != 2 ) {
        System.err.println("Usage: <in> <out>");
        System.exit(2);
    }

    FileSystem hdfs = FileSystem.get(conf);
    Path output = new Path(otherArgs[1]);
    if (hdfs.exists(output))
        hdfs.delete(output, true);

    Job job = new Job(conf,"word count");
    job.setJarByClass(Wordcount.class);

    job.setMapperClass(TokenizerMapper.class);
    job.setReducerClass(ConcatenatorReducer.class);

    job.setOutputKeyClass(Text.class);
    job.setOutputValueClass(Text.class);

    // set number of reduces
    job.setNumReduceTasks(2);

    // set input and output directories
    FileInputFormat.addInputPath(job,new Path(otherArgs[0]));
    FileOutputFormat.setOutputPath(job,new Path(otherArgs[1]));
    System.exit(job.waitForCompletion(true) ? 0 : 1 );
}
}

후

hadoop jar ssafy.jar inverted wordcount_test invertedindex_test_out명령어를 입력해주면 아래와 같이 듭니다.

 

hdfs dfs -cat invertedindex_test_out/part-r-00000|more를 입력하여 결과를 보이면... 너무길게나옵니다..

 

hdfs dfs -cat invertedindex_test_out/part-r-00000|more
All    :wordcount-data.txt:5257
Almighty    :wordcount-data.txt:151
Americans    :wordcount-data.txt:5687,wordcount-data.txt:5611
Americans:    :wordcount-data.txt:6808
Americas.    :wordcount-data.txt:2851
And    :wordcount-data.txt:5012,wordcount-data.txt:2860,wordcount-data.txt:6794,wordcount-data.t
xt:399
But    :wordcount-data.txt:4271,wordcount-data.txt:1878,wordcount-data.txt:2697,wordcount-data.t
xt:5424,wordcount-data.txt:3819
Divided    :wordcount-data.txt:1538
East    :wordcount-data.txt:6209
Finally,    :wordcount-data.txt:7028,wordcount-data.txt:3389
For    :wordcount-data.txt:310,wordcount-data.txt:126,wordcount-data.txt:3695
I    :wordcount-data.txt:129,wordcount-data.txt:6443,wordcount-data.txt:6490
If    :wordcount-data.txt:2366
In    :wordcount-data.txt:5482,wordcount-data.txt:6332
Let    :wordcount-data.txt:2763,wordcount-data.txt:4338,wordcount-data.txt:696,wordcount-data.tx
t:4242,wordcount-data.txt:4439,wordcount-data.txt:1147,wordcount-data.txt:4864,wordcount-data.txt
:4653
Nor    :wordcount-data.txt:5306
North    :wordcount-data.txt:6195
South,    :wordcount-data.txt:6203
The    :wordcount-data.txt:283,wordcount-data.txt:5671,wordcount-data.txt:6572
To    :wordcount-data.txt:1388,wordcount-data.txt:2122,wordcount-data.txt:1674,wordcount-data.t
xt:2510,wordcount-data.txt:3031
United    :wordcount-data.txt:3071,wordcount-data.txt:1480
West,    :wordcount-data.txt:6216
a    :wordcount-data.txt:3224,wordcount-data.txt:4191,wordcount-data.txt:853,wordcount-data.tx
t:2554,wordcount-data.txt:7160,wordcount-data.txt:35,wordcount-data.txt:5927,wordcount-data.txt:6
363,wordcount-data.txt:6171,wordcount-data.txt:5017,wordcount-data.txt:5905,wordcount-data.txt:18
08,wordcount-data.txt:2608,wordcount-data.txt:17,wordcount-data.txt:206,wordcount-data.txt:3466,w
ordcount-data.txt:5866,wordcount-data.txt:1583,wordcount-data.txt:5098,wordcount-data.txt:2368,wo
rdcount-data.txt:5114,wordcount-data.txt:6234,wordcount-data.txt:5827,wordcount-data.txt:1511,wor
dcount-data.txt:781,wordcount-data.txt:5136,wordcount-data.txt:82,wordcount-data.txt:3456
absolute    :wordcount-data.txt:4548,wordcount-data.txt:4590
adversary,    :wordcount-data.txt:3436
again--not    :wordcount-data.txt:5815
against    :wordcount-data.txt:6152,wordcount-data.txt:6015
age    :wordcount-data.txt:3104
ago.    :wordcount-data.txt:231
all    :wordcount-data.txt:6254,wordcount-data.txt:379,wordcount-data.txt:3570,wordcount-data.tx
t:4607,wordcount-data.txt:6650,wordcount-data.txt:4889,wordcount-data.txt:2766,wordcount-data.txt
:354
alliance    :wordcount-data.txt:2612
alliance,    :wordcount-data.txt:6186
always    :wordcount-data.txt:4221,wordcount-data.txt:1838,wordcount-data.txt:1888,wordcount-data.t
xt:981
an    :wordcount-data.txt:69,wordcount-data.txt:3102
and    :wordcount-data.txt:5172,wordcount-data.txt:1036,wordcount-data.txt:1001,wordcount-data.t
xt:214,wordcount-data.txt:376,wordcount-data.txt:5188,wordcount-data.txt:7128,wordcount-data.txt:
3840,wordcount-data.txt:1607,wordcount-data.txt:6647,wordcount-data.txt:2648,wordcount-data.txt:5
955,wordcount-data.txt:148,wordcount-data.txt:4816,wordcount-data.txt:4797,wordcount-data.txt:214
4,wordcount-data.txt:858,wordcount-data.txt:3273,wordcount-data.txt:4207,wordcount-data.txt:6067,
wordcount-data.txt:1417,wordcount-data.txt:6177,wordcount-data.txt:6200,wordcount-data.txt:7277,w
ordcount-data.txt:6213,wordcount-data.txt:1294,wordcount-data.txt:725,wordcount-data.txt:4484,wor
dcount-data.txt:742,wordcount-data.txt:4519
anew    :wordcount-data.txt:3493
answered    :wordcount-data.txt:5699
anywhere    :wordcount-data.txt:2838
area    :wordcount-data.txt:3300
arms    :wordcount-data.txt:3709,wordcount-data.txt:5849
arms,    :wordcount-data.txt:5838
around    :wordcount-data.txt:1039,wordcount-data.txt:473
ask    :wordcount-data.txt:6818,wordcount-data.txt:7087,wordcount-data.txt:6931,wordcount-data.t
xt:7147
asking    :wordcount-data.txt:7260
assist    :wordcount-data.txt:2635
assure    :wordcount-data.txt:1277,wordcount-data.txt:6228
at    :wordcount-data.txt:1601,wordcount-data.txt:466,wordcount-data.txt:1030
atom,    :wordcount-data.txt:3991
back    :wordcount-data.txt:5047,wordcount-data.txt:2010
be    :wordcount-data.txt:5271,wordcount-data.txt:3779,wordcount-data.txt:3742,wordcount-data.t
xt:5315,wordcount-data.txt:1796,wordcount-data.txt:7331,wordcount-data.txt:2309
beachhead    :wordcount-data.txt:5018
become    :wordcount-data.txt:2734
before    :wordcount-data.txt:139,wordcount-data.txt:3514
begin    :wordcount-data.txt:4141,wordcount-data.txt:3488
begin.    :wordcount-data.txt:5432
belaboring    :wordcount-data.txt:4385
belief    :wordcount-data.txt:492
beyond    :wordcount-data.txt:3726,wordcount-data.txt:3751
blessing    :wordcount-data.txt:7269
both    :wordcount-data.txt:3999,wordcount-data.txt:4341,wordcount-data.txt:3945,wordcount-data.t
xt:4165,wordcount-data.txt:4442,wordcount-data.txt:4656,wordcount-data.txt:4867,wordcount-data.tx
t:3479,wordcount-data.txt:5075
break    :wordcount-data.txt:2181
burdens    :wordcount-data.txt:4944
but    :wordcount-data.txt:7288,wordcount-data.txt:6961,wordcount-data.txt:2346,wordcount-data.t
xt:32,wordcount-data.txt:550,wordcount-data.txt:3463,wordcount-data.txt:5902,wordcount-data.txt:5
133
by    :wordcount-data.txt:3920,wordcount-data.txt:3555,wordcount-data.txt:3963,wordcount-data.t
xt:851,wordcount-data.txt:834,wordcount-data.txt:1999,wordcount-data.txt:1806
cannot    :wordcount-data.txt:2728,wordcount-data.txt:2410,wordcount-data.txt:2380,wordcount-data.t
xt:1501
casting    :wordcount-data.txt:2668
challenge    :wordcount-data.txt:1592
citizens    :wordcount-data.txt:6912,wordcount-data.txt:7049,wordcount-data.txt:7068
citizens,    :wordcount-data.txt:5502
civility    :wordcount-data.txt:4178
colonial    :wordcount-data.txt:1751
command    :wordcount-data.txt:4912
commerce.    :wordcount-data.txt:4819
common    :wordcount-data.txt:6025
conquer    :wordcount-data.txt:4745
control    :wordcount-data.txt:4598,wordcount-data.txt:4522,wordcount-data.txt:1759
convert    :wordcount-data.txt:2572
cooperation    :wordcount-data.txt:5029
cooperative    :wordcount-data.txt:1518
cost    :wordcount-data.txt:3925
course.    :wordcount-data.txt:5561
creating    :wordcount-data.txt:5090
danger.    :wordcount-data.txt:6436
days,    :wordcount-data.txt:5346
days.    :wordcount-data.txt:5301
deadly    :wordcount-data.txt:3985
deeds,    :wordcount-data.txt:7222
different    :wordcount-data.txt:297
divide    :wordcount-data.txt:4413
do    :wordcount-data.txt:6865,wordcount-data.txt:6981,wordcount-data.txt:1507,wordcount-data.t
xt:6952,wordcount-data.txt:6842,wordcount-data.txt:6444,wordcount-data.txt:6491
doing    :wordcount-data.txt:2311
each    :wordcount-data.txt:5595
effort?    :wordcount-data.txt:6290
efforts    :wordcount-data.txt:2222
employed.    :wordcount-data.txt:3781
encourage    :wordcount-data.txt:4800
end    :wordcount-data.txt:71
engulf    :wordcount-data.txt:3564
every    :wordcount-data.txt:1150,wordcount-data.txt:2866
exchange    :wordcount-data.txt:6519
expect    :wordcount-data.txt:1844
explore    :wordcount-data.txt:4350,wordcount-data.txt:4729
faithful    :wordcount-data.txt:1464
far    :wordcount-data.txt:1809,wordcount-data.txt:3135
fellow    :wordcount-data.txt:5496,wordcount-data.txt:6802,wordcount-data.txt:6906
find    :wordcount-data.txt:1852,wordcount-data.txt:1900
foolishly    :wordcount-data.txt:1979
for    :wordcount-data.txt:6954,wordcount-data.txt:6983,wordcount-data.txt:3505,wordcount-data.t
xt:4503,wordcount-data.txt:2254,wordcount-data.txt:6867,wordcount-data.txt:2620,wordcount-data.tx
t:6844,wordcount-data.txt:432,wordcount-data.txt:6251,wordcount-data.txt:3230,wordcount-data.txt:
4452
forebears    :wordcount-data.txt:443
forge    :wordcount-data.txt:6147
forget    :wordcount-data.txt:646
forms    :wordcount-data.txt:382,wordcount-data.txt:357
formulate    :wordcount-data.txt:4468
forth    :wordcount-data.txt:708,wordcount-data.txt:7235
forum    :wordcount-data.txt:3225
fought    :wordcount-data.txt:452
founded,    :wordcount-data.txt:5587
freedom--and    :wordcount-data.txt:1934
freedom--symbolizing    :wordcount-data.txt:49
friends.    :wordcount-data.txt:1472
fruitful    :wordcount-data.txt:6239
generations    :wordcount-data.txt:6367
generosity    :wordcount-data.txt:530
give    :wordcount-data.txt:5637
global    :wordcount-data.txt:6180
globe    :wordcount-data.txt:2164
globe.    :wordcount-data.txt:5734
glow    :wordcount-data.txt:6671
good    :wordcount-data.txt:2582,wordcount-data.txt:7161,wordcount-data.txt:2595
granted    :wordcount-data.txt:6386
great    :wordcount-data.txt:3835
half    :wordcount-data.txt:2157
hand    :wordcount-data.txt:4056,wordcount-data.txt:560
hard    :wordcount-data.txt:854
hardship,    :wordcount-data.txt:1237
heavy    :wordcount-data.txt:4939
heirs    :wordcount-data.txt:669
help    :wordcount-data.txt:2239,wordcount-data.txt:2386,wordcount-data.txt:2231
help,    :wordcount-data.txt:7283
historic    :wordcount-data.txt:6282
home    :wordcount-data.txt:1032
human    :wordcount-data.txt:950,wordcount-data.txt:364,wordcount-data.txt:389
humanity    :wordcount-data.txt:3573
if    :wordcount-data.txt:5015
ill,    :wordcount-data.txt:1189
in    :wordcount-data.txt:5088,wordcount-data.txt:3304,wordcount-data.txt:1961,wordcount-data.t
xt:5281,wordcount-data.txt:812,wordcount-data.txt:2666,wordcount-data.txt:3581,wordcount-data.txt
:5325,wordcount-data.txt:1509,wordcount-data.txt:5953,wordcount-data.txt:5976,wordcount-data.txt:
5354,wordcount-data.txt:2135,wordcount-data.txt:5398,wordcount-data.txt:5990,wordcount-data.txt:6
418,wordcount-data.txt:3100,wordcount-data.txt:2846,wordcount-data.txt:321,wordcount-data.txt:627
6,wordcount-data.txt:4887
intends    :wordcount-data.txt:2903
issue    :wordcount-data.txt:468
it    :wordcount-data.txt:1173,wordcount-data.txt:3204,wordcount-data.txt:2408,wordcount-data.t
xt:2356,wordcount-data.txt:5313
it,    :wordcount-data.txt:2316
it.    :wordcount-data.txt:6487
itself.    :wordcount-data.txt:6073
judge    :wordcount-data.txt:7212
jungle    :wordcount-data.txt:5054
know    :wordcount-data.txt:2881,wordcount-data.txt:2781
know,    :wordcount-data.txt:1161
knowing    :wordcount-data.txt:7291
land    :wordcount-data.txt:7249
let    :wordcount-data.txt:5072,wordcount-data.txt:7228,wordcount-data.txt:5427,wordcount-data.t
xt:4274,wordcount-data.txt:4724,wordcount-data.txt:4959,wordcount-data.txt:2863,wordcount-data.tx
t:4136
liberty.    :wordcount-data.txt:1309
lifetime    :wordcount-data.txt:5403
mankind?    :wordcount-data.txt:6257
many    :wordcount-data.txt:2393
may    :wordcount-data.txt:3318,wordcount-data.txt:5040,wordcount-data.txt:2306
meet    :wordcount-data.txt:1230,wordcount-data.txt:1579
mine,    :wordcount-data.txt:5519
misery,    :wordcount-data.txt:2200
modern    :wordcount-data.txt:3931
more    :wordcount-data.txt:1812,wordcount-data.txt:5511,wordcount-data.txt:6235
more.    :wordcount-data.txt:1377
mortal    :wordcount-data.txt:326
much    :wordcount-data.txt:1360
must    :wordcount-data.txt:7322
nation    :wordcount-data.txt:972,wordcount-data.txt:1155
nearly    :wordcount-data.txt:200
need--not    :wordcount-data.txt:5855
neighbors    :wordcount-data.txt:2772
neither    :wordcount-data.txt:3822
nor    :wordcount-data.txt:5384,wordcount-data.txt:5351
not    :wordcount-data.txt:3453,wordcount-data.txt:6493,wordcount-data.txt:2319,wordcount-data.t
xt:5111,wordcount-data.txt:4188,wordcount-data.txt:3670,wordcount-data.txt:14,wordcount-data.txt:
6446,wordcount-data.txt:1576,wordcount-data.txt:6821,wordcount-data.txt:1771,wordcount-data.txt:6
934,wordcount-data.txt:1835,wordcount-data.txt:5268,wordcount-data.txt:643,wordcount-data.txt:520
of    :wordcount-data.txt:5363,wordcount-data.txt:7118,wordcount-data.txt:795,wordcount-data.tx
t:3126,wordcount-data.txt:564,wordcount-data.txt:4060,wordcount-data.txt:2155,wordcount-data.txt:
540,wordcount-data.txt:4036,wordcount-data.txt:4196,wordcount-data.txt:362,wordcount-data.txt:387
,wordcount-data.txt:6510,wordcount-data.txt:6920,wordcount-data.txt:3980,wordcount-data.txt:511,w
ordcount-data.txt:2194,wordcount-data.txt:3929,wordcount-data.txt:1307,wordcount-data.txt:5556,wo
rdcount-data.txt:2014,wordcount-data.txt:5125,wordcount-data.txt:5060,wordcount-data.txt:4264,wor
dcount-data.txt:3857,wordcount-data.txt:25,wordcount-data.txt:3160,wordcount-data.txt:6427,wordco
unt-data.txt:2747,wordcount-data.txt:5027,wordcount-data.txt:943,wordcount-data.txt:4383,wordcoun
t-data.txt:674,wordcount-data.txt:3184,wordcount-data.txt:47,wordcount-data.txt:2722,wordcount-da
ta.txt:5925,wordcount-data.txt:1462,wordcount-data.txt:7217,wordcount-data.txt:2535,wordcount-dat
a.txt:4919,wordcount-data.txt:6400,wordcount-data.txt:4899,wordcount-data.txt:1516,wordcount-data
.txt:3265,wordcount-data.txt:2687,wordcount-data.txt:3533,wordcount-data.txt:5609,wordcount-data.
txt:2927,wordcount-data.txt:6996,wordcount-data.txt:7057,wordcount-data.txt:5145,wordcount-data.t
xt:878,wordcount-data.txt:1713,wordcount-data.txt:5680,wordcount-data.txt:6348,wordcount-data.txt
:3050,wordcount-data.txt:1749,wordcount-data.txt:4529,wordcount-data.txt:7076,wordcount-data.txt:
6038,wordcount-data.txt:7150,wordcount-data.txt:7090,wordcount-data.txt:4703,wordcount-data.txt:4
687,wordcount-data.txt:4605
off    :wordcount-data.txt:2675
old    :wordcount-data.txt:1395
on    :wordcount-data.txt:5411,wordcount-data.txt:4163,wordcount-data.txt:7306
oppressed    :wordcount-data.txt:4965
or    :wordcount-data.txt:921,wordcount-data.txt:5547,wordcount-data.txt:1187,wordcount-data.tx
t:7066,wordcount-data.txt:3590,wordcount-data.txt:2826,wordcount-data.txt:6551
origins    :wordcount-data.txt:1429
outpaced    :wordcount-data.txt:3138
overburdened    :wordcount-data.txt:3908
patient    :wordcount-data.txt:5983
peaceful    :wordcount-data.txt:2704
people    :wordcount-data.txt:2129,wordcount-data.txt:6545
perhaps    :wordcount-data.txt:5391
period    :wordcount-data.txt:2265
permit    :wordcount-data.txt:923
place,    :wordcount-data.txt:728
pledge    :wordcount-data.txt:1446,wordcount-data.txt:2209,wordcount-data.txt:3178,wordcount-data.t
xt:1725,wordcount-data.txt:3457
poverty    :wordcount-data.txt:369
poverty,    :wordcount-data.txt:6052
poverty.    :wordcount-data.txt:2689
power    :wordcount-data.txt:340,wordcount-data.txt:1994,wordcount-data.txt:4556,wordcount-data.tx
t:2876
power,    :wordcount-data.txt:5127
precise    :wordcount-data.txt:4487
prescribed    :wordcount-data.txt:190
present    :wordcount-data.txt:3884
price,    :wordcount-data.txt:1210
proposals    :wordcount-data.txt:4494
ranks    :wordcount-data.txt:1708
remember    :wordcount-data.txt:1948
renew    :wordcount-data.txt:3170
republics    :wordcount-data.txt:2521
request:    :wordcount-data.txt:3467
responsibility--I    :wordcount-data.txt:6463
revolution    :wordcount-data.txt:2712
revolution.    :wordcount-data.txt:685
revolutionary    :wordcount-data.txt:412
reward,    :wordcount-data.txt:7186
riding    :wordcount-data.txt:2001
rightly    :wordcount-data.txt:3949
rights    :wordcount-data.txt:505,wordcount-data.txt:955
run.    :wordcount-data.txt:3321
sacrifice    :wordcount-data.txt:7131
save    :wordcount-data.txt:2416
secure    :wordcount-data.txt:5182
self-destruction.    :wordcount-data.txt:3602
serve    :wordcount-data.txt:6656
service    :wordcount-data.txt:5716
share,    :wordcount-data.txt:1438
shield    :wordcount-data.txt:3259
shrink    :wordcount-data.txt:6449
sign    :wordcount-data.txt:4192
slow    :wordcount-data.txt:932
south    :wordcount-data.txt:2530
special    :wordcount-data.txt:2555
spiritual    :wordcount-data.txt:1420
spread    :wordcount-data.txt:3974
stars,    :wordcount-data.txt:4739
state    :wordcount-data.txt:545
strength    :wordcount-data.txt:7120
strong    :wordcount-data.txt:5159
struggle    :wordcount-data.txt:6007
struggle,    :wordcount-data.txt:5940
success    :wordcount-data.txt:1300,wordcount-data.txt:5540
support    :wordcount-data.txt:1246
supporting    :wordcount-data.txt:1860,wordcount-data.txt:1916
sure    :wordcount-data.txt:7182
suspicion,    :wordcount-data.txt:5062
sworn    :wordcount-data.txt:134
take    :wordcount-data.txt:3866
tap    :wordcount-data.txt:4780
terrors.    :wordcount-data.txt:4708
than    :wordcount-data.txt:5515
that    :wordcount-data.txt:6221,wordcount-data.txt:3475,wordcount-data.txt:6278,wordcount-data.t
xt:1738,wordcount-data.txt:754,wordcount-data.txt:2885,wordcount-data.txt:676,wordcount-data.txt:
3033,wordcount-data.txt:657,wordcount-data.txt:6679,wordcount-data.txt:498,wordcount-data.txt:650
3,wordcount-data.txt:1193,wordcount-data.txt:2785,wordcount-data.txt:4016,wordcount-data.txt:3762
,wordcount-data.txt:4044,wordcount-data.txt:4174,wordcount-data.txt:7298
that,    :wordcount-data.txt:1956
the    :wordcount-data.txt:2918,wordcount-data.txt:5327,wordcount-data.txt:5283,wordcount-data.t
xt:1452,wordcount-data.txt:1045,wordcount-data.txt:5191,wordcount-data.txt:5707,wordcount-data.tx
t:5175,wordcount-data.txt:5731,wordcount-data.txt:5156,wordcount-data.txt:5796,wordcount-data.txt
:5051,wordcount-data.txt:929,wordcount-data.txt:5916,wordcount-data.txt:4962,wordcount-data.txt:5
356,wordcount-data.txt:4936,wordcount-data.txt:4909,wordcount-data.txt:4901,wordcount-data.txt:17
05,wordcount-data.txt:4809,wordcount-data.txt:1715,wordcount-data.txt:4783,wordcount-data.txt:475
2,wordcount-data.txt:4736,wordcount-data.txt:6022,wordcount-data.txt:4677,wordcount-data.txt:4587
,wordcount-data.txt:758,wordcount-data.txt:4545,wordcount-data.txt:6334,wordcount-data.txt:4506,w
ordcount-data.txt:6350,wordcount-data.txt:4455,wordcount-data.txt:6393,wordcount-data.txt:699,wor
dcount-data.txt:666,wordcount-data.txt:1963,wordcount-data.txt:2007,wordcount-data.txt:2016,wordc
ount-data.txt:557,wordcount-data.txt:2137,wordcount-data.txt:542,wordcount-data.txt:4053,wordcoun
t-data.txt:2161,wordcount-data.txt:6582,wordcount-data.txt:527,wordcount-data.txt:6591,wordcount-
data.txt:3982,wordcount-data.txt:2186,wordcount-data.txt:3965,wordcount-data.txt:3922,wordcount-d
ata.txt:502,wordcount-data.txt:479,wordcount-data.txt:6668,wordcount-data.txt:2293,wordcount-data
.txt:405,wordcount-data.txt:6700,wordcount-data.txt:6922,wordcount-data.txt:2390,wordcount-data.t
xt:1297,wordcount-data.txt:2420,wordcount-data.txt:337,wordcount-data.txt:6986,wordcount-data.txt
:3520,wordcount-data.txt:3497,wordcount-data.txt:7078,wordcount-data.txt:7098,wordcount-data.txt:
162,wordcount-data.txt:3297,wordcount-data.txt:2678,wordcount-data.txt:3276,wordcount-data.txt:32
67,wordcount-data.txt:7204,wordcount-data.txt:1283,wordcount-data.txt:2740,wordcount-data.txt:724
6,wordcount-data.txt:5532,wordcount-data.txt:3146,wordcount-data.txt:3112,wordcount-data.txt:2848
,wordcount-data.txt:3068
these    :wordcount-data.txt:6159
those    :wordcount-data.txt:4395,wordcount-data.txt:3399,wordcount-data.txt:1971,wordcount-data.t
xt:1390,wordcount-data.txt:2124,wordcount-data.txt:945,wordcount-data.txt:1676
though    :wordcount-data.txt:5843,wordcount-data.txt:5880
tiger    :wordcount-data.txt:2019
time    :wordcount-data.txt:721
time,    :wordcount-data.txt:4463
to    :wordcount-data.txt:4234,wordcount-data.txt:345,wordcount-data.txt:1004,wordcount-data.tx
t:4288,wordcount-data.txt:1946,wordcount-data.txt:1898,wordcount-data.txt:734,wordcount-data.txt:
1850,wordcount-data.txt:4561,wordcount-data.txt:779,wordcount-data.txt:4669,wordcount-data.txt:17
94,wordcount-data.txt:3397,wordcount-data.txt:912,wordcount-data.txt:3288,wordcount-data.txt:4881
,wordcount-data.txt:1703,wordcount-data.txt:5714,wordcount-data.txt:5650,wordcount-data.txt:7240,
wordcount-data.txt:2910,wordcount-data.txt:5910,wordcount-data.txt:5635,wordcount-data.txt:5871,w
ordcount-data.txt:961,wordcount-data.txt:2229,wordcount-data.txt:5832,wordcount-data.txt:6614,wor
dcount-data.txt:2808,wordcount-data.txt:2179,wordcount-data.txt:4009,wordcount-data.txt:1275
today    :wordcount-data.txt:652,wordcount-data.txt:1025,wordcount-data.txt:9
trumpet    :wordcount-data.txt:5799
tyranny,    :wordcount-data.txt:6044
tyranny.    :wordcount-data.txt:1820
uncertain    :wordcount-data.txt:4020
unite    :wordcount-data.txt:4369,wordcount-data.txt:4876
unleashed    :wordcount-data.txt:3546
unwilling    :wordcount-data.txt:903
up    :wordcount-data.txt:2029
view.    :wordcount-data.txt:1873
villages    :wordcount-data.txt:2147
votes,    :wordcount-data.txt:2340
was    :wordcount-data.txt:5584
weak--and    :wordcount-data.txt:3279
weakness,    :wordcount-data.txt:4198
weakness.    :wordcount-data.txt:3686
weapons,    :wordcount-data.txt:3937
where    :wordcount-data.txt:5151,wordcount-data.txt:3107
whether    :wordcount-data.txt:1166,wordcount-data.txt:7036
which    :wordcount-data.txt:7140,wordcount-data.txt:435,wordcount-data.txt:3306,wordcount-data.tx
t:6602,wordcount-data.txt:963,wordcount-data.txt:4408,wordcount-data.txt:1006
whom    :wordcount-data.txt:1690
wishes    :wordcount-data.txt:1175
witness    :wordcount-data.txt:914
words    :wordcount-data.txt:2586
work    :wordcount-data.txt:7318
would    :wordcount-data.txt:3414,wordcount-data.txt:6514
year    :wordcount-data.txt:5949,wordcount-data.txt:5958
you    :wordcount-data.txt:6859,wordcount-data.txt:7043,wordcount-data.txt:6269,wordcount-data.t
xt:145
you,    :wordcount-data.txt:6957
you.    :wordcount-data.txt:7152
your    :wordcount-data.txt:6828,wordcount-data.txt:5484,wordcount-data.txt:6870
hadoop@ubuntu:~/Project$ 

00001 |more 은 아래와 같습니다.

 

 

hadoop@ubuntu:~/Project$ 
hadoop@ubuntu:~/Project$ hdfs dfs -cat invertedindex_test_out/part-r-00001|more
"rejoicing    :wordcount-data.txt:5966
"undo    :wordcount-data.txt:4931
(and)    :wordcount-data.txt:4954
.    :wordcount-data.txt:4952,wordcount-data.txt:4951,wordcount-data.txt:4953
Administration,    :wordcount-data.txt:5369
America    :wordcount-data.txt:7059,wordcount-data.txt:6941
Americans--born    :wordcount-data.txt:797
Can    :wordcount-data.txt:6142
God    :wordcount-data.txt:159
God's    :wordcount-data.txt:7313
God.    :wordcount-data.txt:566
Hemisphere    :wordcount-data.txt:2893
His    :wordcount-data.txt:7266,wordcount-data.txt:7280
Isaiah--to    :wordcount-data.txt:4921
My    :wordcount-data.txt:6904
Nations,    :wordcount-data.txt:3077
Now    :wordcount-data.txt:5793
Since    :wordcount-data.txt:5568
So    :wordcount-data.txt:4134
This    :wordcount-data.txt:1356
Together    :wordcount-data.txt:4716
We    :wordcount-data.txt:0,wordcount-data.txt:3664,wordcount-data.txt:1828,wordcount-data.txt:
637
Will    :wordcount-data.txt:6265
With    :wordcount-data.txt:7156
abolish    :wordcount-data.txt:347
accidental    :wordcount-data.txt:3592
aggression    :wordcount-data.txt:2816
alarmed    :wordcount-data.txt:3956
alike,    :wordcount-data.txt:748
allies    :wordcount-data.txt:1398
alter    :wordcount-data.txt:4011
ancient    :wordcount-data.txt:883
anew--remembering    :wordcount-data.txt:4146
any    :wordcount-data.txt:1253,wordcount-data.txt:6537,wordcount-data.txt:1269,wordcount-data.t
xt:1234,wordcount-data.txt:6507,wordcount-data.txt:6553,wordcount-data.txt:1220,wordcount-data.tx
t:1207
are    :wordcount-data.txt:2429,wordcount-data.txt:663,wordcount-data.txt:5165,wordcount-data.tx
t:1013,wordcount-data.txt:458,wordcount-data.txt:3713,wordcount-data.txt:2400,wordcount-data.txt:
7046
are--    :wordcount-data.txt:5897
arms--and    :wordcount-data.txt:4531
arts    :wordcount-data.txt:4812
as    :wordcount-data.txt:74,wordcount-data.txt:111,wordcount-data.txt:117,wordcount-data.txt:5
825,wordcount-data.txt:80,wordcount-data.txt:5864
assembly    :wordcount-data.txt:3042
asunder.    :wordcount-data.txt:1615
away    :wordcount-data.txt:1784
balance    :wordcount-data.txt:4029,wordcount-data.txt:5118
battle,    :wordcount-data.txt:5873
bear    :wordcount-data.txt:5834,wordcount-data.txt:1216,wordcount-data.txt:5912
because    :wordcount-data.txt:2286,wordcount-data.txt:2349,wordcount-data.txt:2322
becoming    :wordcount-data.txt:3210
been    :wordcount-data.txt:5623,wordcount-data.txt:6382,wordcount-data.txt:769,wordcount-data.tx
t:987
beginning--signifying    :wordcount-data.txt:83
beliefs    :wordcount-data.txt:425
believe    :wordcount-data.txt:6496
best    :wordcount-data.txt:3092,wordcount-data.txt:2218
bitter    :wordcount-data.txt:861
bonds    :wordcount-data.txt:2189
border,    :wordcount-data.txt:2540
bring    :wordcount-data.txt:4540,wordcount-data.txt:6609
burden    :wordcount-data.txt:5919
burden,    :wordcount-data.txt:1223
call    :wordcount-data.txt:5906,wordcount-data.txt:5828,wordcount-data.txt:5710,wordcount-data.t
xt:5867
can    :wordcount-data.txt:6687,wordcount-data.txt:6225,wordcount-data.txt:6978,wordcount-data.t
xt:6862,wordcount-data.txt:6839,wordcount-data.txt:3737,wordcount-data.txt:1560,wordcount-data.tx
t:3829
celebration    :wordcount-data.txt:36
century    :wordcount-data.txt:207
century,    :wordcount-data.txt:818
certain    :wordcount-data.txt:3744
chains    :wordcount-data.txt:2681
change.    :wordcount-data.txt:119
come    :wordcount-data.txt:516
comfort    :wordcount-data.txt:3870
committed    :wordcount-data.txt:1016
committed,    :wordcount-data.txt:991
communists    :wordcount-data.txt:2296
conscience    :wordcount-data.txt:7165
corners    :wordcount-data.txt:4892
country    :wordcount-data.txt:5577,wordcount-data.txt:6832,wordcount-data.txt:6640
country.    :wordcount-data.txt:6874
course--both    :wordcount-data.txt:3891
cultural    :wordcount-data.txt:1409
dare    :wordcount-data.txt:3666,wordcount-data.txt:639,wordcount-data.txt:1572
dark    :wordcount-data.txt:3523
deeds--in    :wordcount-data.txt:2599
defending    :wordcount-data.txt:6402
depths    :wordcount-data.txt:4791
deserts,    :wordcount-data.txt:4755
destroy    :wordcount-data.txt:4563
destruction    :wordcount-data.txt:3535
devotion    :wordcount-data.txt:6594
disciplined    :wordcount-data.txt:840
disease    :wordcount-data.txt:6060
disease,    :wordcount-data.txt:4772
do--for    :wordcount-data.txt:1563
doubt    :wordcount-data.txt:3757,wordcount-data.txt:3732
earth    :wordcount-data.txt:4904,wordcount-data.txt:7308
embattled    :wordcount-data.txt:5886
endeavor    :wordcount-data.txt:6620
endeavor,    :wordcount-data.txt:5102
ended    :wordcount-data.txt:2024
enemies    :wordcount-data.txt:6164,wordcount-data.txt:6031
energy,    :wordcount-data.txt:6575
enlarge    :wordcount-data.txt:3290
eradicate    :wordcount-data.txt:4763
even    :wordcount-data.txt:5387
failure    :wordcount-data.txt:5549
faith,    :wordcount-data.txt:6585
fear    :wordcount-data.txt:4284
fear.    :wordcount-data.txt:4266
few    :wordcount-data.txt:2423,wordcount-data.txt:6364
final    :wordcount-data.txt:7207,wordcount-data.txt:5535,wordcount-data.txt:4071
finished    :wordcount-data.txt:5273,wordcount-data.txt:5317
fire    :wordcount-data.txt:6683
first    :wordcount-data.txt:4458,wordcount-data.txt:680,wordcount-data.txt:5286,wordcount-data.tx
t:5330
foe    :wordcount-data.txt:745,wordcount-data.txt:1272
forbears    :wordcount-data.txt:182
form    :wordcount-data.txt:1745
free    :wordcount-data.txt:2641,wordcount-data.txt:2651,wordcount-data.txt:2369
free,    :wordcount-data.txt:1718
free."    :wordcount-data.txt:4976
freedom    :wordcount-data.txt:6989,wordcount-data.txt:6411
friend    :wordcount-data.txt:736
friend,    :wordcount-data.txt:1256
from    :wordcount-data.txt:3877,wordcount-data.txt:523,wordcount-data.txt:3206,wordcount-data.tx
t:6455,wordcount-data.txt:713,wordcount-data.txt:6675,wordcount-data.txt:553
generation    :wordcount-data.txt:785,wordcount-data.txt:5599
generation.    :wordcount-data.txt:6561
globe--the    :wordcount-data.txt:482
go    :wordcount-data.txt:4974,wordcount-data.txt:7233,wordcount-data.txt:706
governments    :wordcount-data.txt:2655
grand    :wordcount-data.txt:6172
graves    :wordcount-data.txt:5674
groups    :wordcount-data.txt:3851
hands    :wordcount-data.txt:332
hands,    :wordcount-data.txt:5488
has    :wordcount-data.txt:766,wordcount-data.txt:978,wordcount-data.txt:5620
have    :wordcount-data.txt:6378,wordcount-data.txt:3131,wordcount-data.txt:1774,wordcount-data.t
xt:130
heed    :wordcount-data.txt:4883
here    :wordcount-data.txt:7302,wordcount-data.txt:7094
heritage--and    :wordcount-data.txt:890
high    :wordcount-data.txt:7105
his    :wordcount-data.txt:323
history    :wordcount-data.txt:6341,wordcount-data.txt:7197
holds    :wordcount-data.txt:316
hope    :wordcount-data.txt:3096,wordcount-data.txt:2724,wordcount-data.txt:1894
hope,    :wordcount-data.txt:5978
host    :wordcount-data.txt:1512
hostile    :wordcount-data.txt:2749
hour    :wordcount-data.txt:6423
house.    :wordcount-data.txt:2935
hundred    :wordcount-data.txt:5294
huts    :wordcount-data.txt:2140
inside.    :wordcount-data.txt:2031
inspection    :wordcount-data.txt:4509
instead    :wordcount-data.txt:4376,wordcount-data.txt:4696
instruments    :wordcount-data.txt:3115,wordcount-data.txt:3149
into    :wordcount-data.txt:2591
invective--to    :wordcount-data.txt:3233
invoke    :wordcount-data.txt:4671
iron    :wordcount-data.txt:1816
is    :wordcount-data.txt:2271,wordcount-data.txt:2358,wordcount-data.txt:4186,wordcount-data.t
xt:291,wordcount-data.txt:4219,wordcount-data.txt:1550,wordcount-data.txt:1491
it--and    :wordcount-data.txt:6661
its    :wordcount-data.txt:5652,wordcount-data.txt:2929,wordcount-data.txt:3256,wordcount-data.t
xt:3311,wordcount-data.txt:6420,wordcount-data.txt:4705
join    :wordcount-data.txt:6272,wordcount-data.txt:5084,wordcount-data.txt:2796
just    :wordcount-data.txt:5168
last    :wordcount-data.txt:3088
law,    :wordcount-data.txt:5147
lead    :wordcount-data.txt:7242
life    :wordcount-data.txt:5359,wordcount-data.txt:6247
life.    :wordcount-data.txt:394
light    :wordcount-data.txt:6695,wordcount-data.txt:6632
little    :wordcount-data.txt:1552,wordcount-data.txt:1493
long    :wordcount-data.txt:5928,wordcount-data.txt:6337
love,    :wordcount-data.txt:7255
loyalty    :wordcount-data.txt:1455
loyalty.    :wordcount-data.txt:5663
make    :wordcount-data.txt:3419
man    :wordcount-data.txt:313,wordcount-data.txt:513
man.    :wordcount-data.txt:6998
man:    :wordcount-data.txt:6040
mankind's    :wordcount-data.txt:4062
mass    :wordcount-data.txt:2196
master    :wordcount-data.txt:2921
maximum    :wordcount-data.txt:6429
men    :wordcount-data.txt:2645
merely    :wordcount-data.txt:1788,wordcount-data.txt:3218
my    :wordcount-data.txt:6800,wordcount-data.txt:5494
national    :wordcount-data.txt:5655
nations    :wordcount-data.txt:3859,wordcount-data.txt:4575,wordcount-data.txt:3404
nations.    :wordcount-data.txt:4610
negotiate    :wordcount-data.txt:4252
negotiate.    :wordcount-data.txt:4290
never    :wordcount-data.txt:4247,wordcount-data.txt:3774,wordcount-data.txt:4279
new    :wordcount-data.txt:782,wordcount-data.txt:5137,wordcount-data.txt:5115,wordcount-data.tx
t:5099,wordcount-data.txt:1681,wordcount-data.txt:3270,wordcount-data.txt:2609
now.    :wordcount-data.txt:306
oath    :wordcount-data.txt:175
observe    :wordcount-data.txt:2
ocean    :wordcount-data.txt:4786
odds    :wordcount-data.txt:1603
offer    :wordcount-data.txt:3448,wordcount-data.txt:2549
one    :wordcount-data.txt:5335,wordcount-data.txt:1742,wordcount-data.txt:5291
only    :wordcount-data.txt:6359,wordcount-data.txt:7178,wordcount-data.txt:3698
oppose    :wordcount-data.txt:1263,wordcount-data.txt:2810
other    :wordcount-data.txt:6556,wordcount-data.txt:4570,wordcount-data.txt:6540,wordcount-data.t
xt:2871
our    :wordcount-data.txt:2579,wordcount-data.txt:2537,wordcount-data.txt:2512,wordcount-data.t
xt:3706,wordcount-data.txt:1870,wordcount-data.txt:3433,wordcount-data.txt:7175,wordcount-data.tx
t:440,wordcount-data.txt:3881,wordcount-data.txt:2215,wordcount-data.txt:3175,wordcount-data.txt:
2769,wordcount-data.txt:7219,wordcount-data.txt:5558,wordcount-data.txt:6637,wordcount-data.txt:8
80,wordcount-data.txt:1731,wordcount-data.txt:3085,wordcount-data.txt:7333,wordcount-data.txt:179
,wordcount-data.txt:5400
out    :wordcount-data.txt:4261
out,    :wordcount-data.txt:5962
own    :wordcount-data.txt:2932,wordcount-data.txt:1931
own.    :wordcount-data.txt:7336
party    :wordcount-data.txt:27
passed    :wordcount-data.txt:1778,wordcount-data.txt:773
past,    :wordcount-data.txt:1966
pay    :wordcount-data.txt:1204
peace    :wordcount-data.txt:5194
peace,    :wordcount-data.txt:867,wordcount-data.txt:3162,wordcount-data.txt:3508
places    :wordcount-data.txt:6527
planet.    :wordcount-data.txt:5417
planned    :wordcount-data.txt:3583
pledge--and    :wordcount-data.txt:1366
pledge--to    :wordcount-data.txt:2562
poor,    :wordcount-data.txt:2403
powerful    :wordcount-data.txt:1584,wordcount-data.txt:3843
powers    :wordcount-data.txt:3527
powers.    :wordcount-data.txt:2756
preserved.    :wordcount-data.txt:5199
prevent    :wordcount-data.txt:3197
prey    :wordcount-data.txt:2743
problems    :wordcount-data.txt:4400,wordcount-data.txt:4361
progress--to    :wordcount-data.txt:2623
proof.    :wordcount-data.txt:4236
proud    :wordcount-data.txt:873
push    :wordcount-data.txt:5043
quest    :wordcount-data.txt:3500
racing    :wordcount-data.txt:4003
remain    :wordcount-data.txt:2912
renewal    :wordcount-data.txt:104
replaced    :wordcount-data.txt:1798
required--not    :wordcount-data.txt:2273
rest    :wordcount-data.txt:5528
rich.    :wordcount-data.txt:2432
right.    :wordcount-data.txt:2360
role    :wordcount-data.txt:6396
same    :wordcount-data.txt:165,wordcount-data.txt:7101,wordcount-data.txt:408
science    :wordcount-data.txt:3557,wordcount-data.txt:4689
seek    :wordcount-data.txt:4665,wordcount-data.txt:2331
serious    :wordcount-data.txt:4477
shall    :wordcount-data.txt:1883,wordcount-data.txt:2791,wordcount-data.txt:1830,wordcount-data.t
xt:1199,wordcount-data.txt:1766
sides    :wordcount-data.txt:4871,wordcount-data.txt:4345,wordcount-data.txt:3483,wordcount-data.t
xt:4660,wordcount-data.txt:3903,wordcount-data.txt:5079,wordcount-data.txt:4169
sides,    :wordcount-data.txt:4446
sincerity    :wordcount-data.txt:4210
sister    :wordcount-data.txt:2515
so,    :wordcount-data.txt:6797
society    :wordcount-data.txt:2373
solemn    :wordcount-data.txt:169
sought    :wordcount-data.txt:1988
sovereign    :wordcount-data.txt:3052
split    :wordcount-data.txt:1610
standards    :wordcount-data.txt:7109
states    :wordcount-data.txt:1684
states,    :wordcount-data.txt:3061
stays    :wordcount-data.txt:4048
steady    :wordcount-data.txt:3968
still    :wordcount-data.txt:461
strengthen    :wordcount-data.txt:3246
strongly    :wordcount-data.txt:1908
struggling    :wordcount-data.txt:2169
subject    :wordcount-data.txt:4227
subversion    :wordcount-data.txt:2828
sufficient    :wordcount-data.txt:3716
summoned    :wordcount-data.txt:5627
summons    :wordcount-data.txt:5806
support--to    :wordcount-data.txt:3186
surround    :wordcount-data.txt:5723
survival    :wordcount-data.txt:1286
tempered    :wordcount-data.txt:826
tempt    :wordcount-data.txt:3673
terror    :wordcount-data.txt:4038
testimony    :wordcount-data.txt:5641
their    :wordcount-data.txt:1926,wordcount-data.txt:2335
them    :wordcount-data.txt:1856,wordcount-data.txt:3678,wordcount-data.txt:1904,wordcount-data.t
xt:2235,wordcount-data.txt:2804
themselves    :wordcount-data.txt:3423
themselves,    :wordcount-data.txt:2243
there    :wordcount-data.txt:1486,wordcount-data.txt:1545
they    :wordcount-data.txt:3766
this    :wordcount-data.txt:5573,wordcount-data.txt:2889,wordcount-data.txt:6459,wordcount-data.t
xt:717,wordcount-data.txt:814,wordcount-data.txt:6616,wordcount-data.txt:2700,wordcount-data.txt:
968,wordcount-data.txt:5260,wordcount-data.txt:5365,wordcount-data.txt:5413
thousand    :wordcount-data.txt:5338
three-quarters    :wordcount-data.txt:217
together    :wordcount-data.txt:6968
torch    :wordcount-data.txt:761
tribulation"--a    :wordcount-data.txt:5992
truly    :wordcount-data.txt:6690,wordcount-data.txt:7326
twilight    :wordcount-data.txt:5932
two    :wordcount-data.txt:3832
under    :wordcount-data.txt:4582
undoing    :wordcount-data.txt:936
us    :wordcount-data.txt:7092,wordcount-data.txt:4727,wordcount-data.txt:4245,wordcount-data.t
xt:4277,wordcount-data.txt:5430,wordcount-data.txt:6512,wordcount-data.txt:5813,wordcount-data.tx
t:7231,wordcount-data.txt:1181,wordcount-data.txt:4374,wordcount-data.txt:4139
us.    :wordcount-data.txt:4419
ventures.    :wordcount-data.txt:1529
very    :wordcount-data.txt:293
victory    :wordcount-data.txt:18
war    :wordcount-data.txt:6070,wordcount-data.txt:3128
war,    :wordcount-data.txt:836
war.    :wordcount-data.txt:4076
we    :wordcount-data.txt:3168,wordcount-data.txt:6607,wordcount-data.txt:5895,wordcount-data.t
xt:1558,wordcount-data.txt:2329,wordcount-data.txt:3740,wordcount-data.txt:7253,wordcount-data.tx
t:661,wordcount-data.txt:1499,wordcount-data.txt:2789,wordcount-data.txt:1881,wordcount-data.txt:
6145,wordcount-data.txt:1197,wordcount-data.txt:6976,wordcount-data.txt:1011,wordcount-data.txt:2
207,wordcount-data.txt:1570,wordcount-data.txt:5853,wordcount-data.txt:3446,wordcount-data.txt:14
44,wordcount-data.txt:7145,wordcount-data.txt:1723,wordcount-data.txt:2547,wordcount-data.txt:169
4,wordcount-data.txt:1436,wordcount-data.txt:1364
weak    :wordcount-data.txt:5178
welcome    :wordcount-data.txt:1696,wordcount-data.txt:6480
well    :wordcount-data.txt:113,wordcount-data.txt:76,wordcount-data.txt:1183
what    :wordcount-data.txt:6937,wordcount-data.txt:6824,wordcount-data.txt:6855,wordcount-data.t
xt:6964,wordcount-data.txt:4357
whatever    :wordcount-data.txt:2257
when    :wordcount-data.txt:3702
who    :wordcount-data.txt:1976,wordcount-data.txt:2426,wordcount-data.txt:5696,wordcount-data.t
xt:3411,wordcount-data.txt:2397,wordcount-data.txt:6653
whose    :wordcount-data.txt:1404
will    :wordcount-data.txt:5309,wordcount-data.txt:6628,wordcount-data.txt:5264,wordcount-data.t
xt:5524,wordcount-data.txt:6948,wordcount-data.txt:3770
with    :wordcount-data.txt:3682,wordcount-data.txt:2800,wordcount-data.txt:6533,wordcount-data.t
xt:7193
wonders    :wordcount-data.txt:4680
word    :wordcount-data.txt:702,wordcount-data.txt:1734
world    :wordcount-data.txt:5140,wordcount-data.txt:286,wordcount-data.txt:3037
world,    :wordcount-data.txt:7081,wordcount-data.txt:6353
world.    :wordcount-data.txt:6703,wordcount-data.txt:1048
world:    :wordcount-data.txt:6925
writ    :wordcount-data.txt:3314
yet    :wordcount-data.txt:3996,wordcount-data.txt:402
you--ask    :wordcount-data.txt:6847
young    :wordcount-data.txt:5682

프로젝트 #4

 

에러

1

java.lang.NoSuchMethodException: ssafy.MatrixAdd.main([Ljava.lang.String;)

**해결 방법

중괄호문제다,,,덜 닫혔었다...

2

결과값이 10이다??

 

원인 : matadd test 를 두번 겹쳣는지 이유는 명확하지않다.

다만 제일 의심가는 것이 matadd -2x2 와 matadd 두가지 모두 data 파일을 생성했던것같은데 이떄문에 오류가뜬 것 같았다...

그래서 hdfs dfs -rm matadd_test를 이용하여 아예 삭제해버리고 다시 ant부터 시작했다!

 

결과는 성공적이였다!