Small World Phenomenon on Twitter Data ¶

$\textit{First Short Report} $ ¶

Data Science Laboratory ¶

Introduction¶

The purpose of this report is to have a brief summary about my work since last week. Before last week's lesson I was able to gather tweets via the $\texttt{tweepy}$ package.

About last week¶

After being able to stream tweets, my next task was to prepare the data. The data originally comes in $\texttt{.json}$ format, but there were some decoding error, which I was not able handle properly at the beginning.

On my personal laptop, after loading in the files, the dictionary was encoded in unicode, but while loading in, the keys were unicodes:

>>> list(tweets[0].keys())

[u'quote_count', u'contributors', u'truncated', u'text', u'is_quote_status', u'in_reply_to_status_id', u'reply_count', u'id', u'favorite_count', u'entities', u'retweeted', u'coordinates', u'timestamp_ms', u'source', u'in_reply_to_screen_name', u'id_str', u'retweet_count', u'in_reply_to_user_id', u'favorited', u'user', u'geo', u'in_reply_to_user_id_str', u'lang', u'extended_tweet', u'created_at', u'filter_level', u'in_reply_to_status_id_str', u'place']

So I tried the exact same method on the kooplex server, and somehow it worked.

import ast
import pandas as pd
import json
import re
import nltk

with open('tweets.txt') as f:
    data = f.readlines()

tweets = []
for k in data:
    tweets.append(json.loads(k))

list(tweets[0].keys())

['created_at',
 'id',
 'id_str',
 'text',
 'source',
 'truncated',
 'in_reply_to_status_id',
 'in_reply_to_status_id_str',
 'in_reply_to_user_id',
 'in_reply_to_user_id_str',
 'in_reply_to_screen_name',
 'user',
 'geo',
 'coordinates',
 'place',
 'contributors',
 'retweeted_status',
 'is_quote_status',
 'quote_count',
 'reply_count',
 'retweet_count',
 'favorite_count',
 'entities',
 'favorited',
 'retweeted',
 'filter_level',
 'lang',
 'timestamp_ms']

After figuring out these problems, for easier handling, I am going to load in everything into a Pandas DataFrame.

df = pd.DataFrame(tweets)

df.head()

The next task is to get the core of the words in each text

print('Sample text: ' + df.text[3])

Sample text: RT @TalbertSwan: Barack Obama: 8 yrs

0 indictments
0 porn stars raw dogged and paid
0 pedophiles endorsed
0 racists pardoned
0 mass murder…

I can access numerous things via their keys:

key = 'friends_count'

for i in df.user.values:
    print(i[key])

4349
6412
64
487
233
254
400
52
954
270
323
4812
60
646
197
16465
1256
3695
2028
134
204
6871
397
72
4964
99
8355
30
228
988
16465
33
2
1189
224
11082
1558
47636
420
135
3022
2466
308
679
3608
9211
588
5002
623
919
28
158
135

I can even access the users themselves.

df.user[1]

{'id': 21390418,
 'id_str': '21390418',
 'name': '𝔇𝔬𝔠',
 'screen_name': 'xxdr_zombiexx',
 'location': '#NaziAmerica',
 'url': None,
 'description': 'ACT UP NOW.\n\nVote next year.\n\n#RepublicansHateYou',
 'translator_type': 'none',
 'protected': False,
 'verified': False,
 'followers_count': 7176,
 'friends_count': 6412,
 'listed_count': 85,
 'favourites_count': 44817,
 'statuses_count': 128671,
 'created_at': 'Fri Feb 20 11:38:00 +0000 2009',
 'utc_offset': None,
 'time_zone': None,
 'geo_enabled': False,
 'lang': None,
 'contributors_enabled': False,
 'is_translator': False,
 'profile_background_color': '81E74B',
 'profile_background_image_url': 'http://abs.twimg.com/images/themes/theme1/bg.png',
 'profile_background_image_url_https': 'https://abs.twimg.com/images/themes/theme1/bg.png',
 'profile_background_tile': True,
 'profile_link_color': '000000',
 'profile_sidebar_border_color': '1B1F19',
 'profile_sidebar_fill_color': '83D1E6',
 'profile_text_color': '333333',
 'profile_use_background_image': True,
 'profile_image_url': 'http://pbs.twimg.com/profile_images/1171249920701079553/NPMm6vzy_normal.jpg',
 'profile_image_url_https': 'https://pbs.twimg.com/profile_images/1171249920701079553/NPMm6vzy_normal.jpg',
 'profile_banner_url': 'https://pbs.twimg.com/profile_banners/21390418/1567362033',
 'default_profile': False,
 'default_profile_image': False,
 'following': None,
 'follow_request_sent': None,
 'notifications': None}

Via the $\texttt{nltk}$ package I can use the text.

trump_tweet = 'Having great meetings and discussions with my friend, President @EmmanuelMacron of France. We are in the midst of meetings on Iran, Syria and Trade. We will be holding a joint press conference shortly, here at the @WhiteHouse. 🇺🇸🇫🇷'

nltk.download('stopwords')
nltk.download('punkt')

from nltk.stem import SnowballStemmer

snow = SnowballStemmer('english',ignore_stopwords=True)
for word in nltk.word_tokenize(df.text[0].lower())[0:10]:
    print(word,'->',snow.stem(word))
#match the words of same meanning

[nltk_data] Downloading package stopwords to /home/ahmitr/nltk_data...
[nltk_data]   Package stopwords is already up-to-date!
[nltk_data] Downloading package punkt to /home/ahmitr/nltk_data...
[nltk_data]   Package punkt is already up-to-date!
always -> alway
wondered -> wonder
about -> about
the -> the
great -> great
cj -> cj
flipflop -> flipflop
. -> .

Here I tokenize all the tweets.

for k in df.text:
    print('\n' + k + '\n')
    for word in nltk.word_tokenize(k.lower()):

        print(word,'->',snow.stem(word))

Always wondered about the great CJ flipflop.

always -> alway
wondered -> wonder
about -> about
the -> the
great -> great
cj -> cj
flipflop -> flipflop
. -> .

RT @RedNationRising: Daily Reminder

Hillary Clinton PAYED British &amp; Russian Government Sources to dig up dirt on candidate Trump so she co…

rt -> rt
@ -> @
rednationrising -> rednationris
: -> :
daily -> daili
reminder -> remind
hillary -> hillari
clinton -> clinton
payed -> pay
british -> british
& -> &
amp -> amp
; -> ;
russian -> russian
government -> govern
sources -> sourc
to -> to
dig -> dig
up -> up
dirt -> dirt
on -> on
candidate -> candid
trump -> trump
so -> so
she -> she
co… -> co…

RT @thebradfordfile: Clinton Foundation contributions:

2015: $183 million
2016: $135 million
2017:   $23 million

Why would foreign govern…

rt -> rt
@ -> @
thebradfordfile -> thebradfordfil
: -> :
clinton -> clinton
foundation -> foundat
contributions -> contribut
: -> :
2015 -> 2015
: -> :
$ -> $
183 -> 183
million -> million
2016 -> 2016
: -> :
$ -> $
135 -> 135
million -> million
2017 -> 2017
: -> :
$ -> $
23 -> 23
million -> million
why -> why
would -> would
foreign -> foreign
govern… -> govern…

RT @HillaryClinton: Please don't miss this interview in which my co-author is extra charming. 💛https://t.co/b4RMDncxJu

rt -> rt
@ -> @
hillaryclinton -> hillaryclinton
: -> :
please -> pleas
do -> do
n't -> n't
miss -> miss
this -> this
interview -> interview
in -> in
which -> which
my -> my
co-author -> co-author
is -> is
extra -> extra
charming -> charm
. -> .
💛https -> 💛https
: -> :
//t.co/b4rmdncxju -> //t.co/b4rmdncxju

RT @daviddoel: So this is why Vincent D'Onofrio's is so good at playing the disturbed guy with manic outbursts. https://t.co/Ov1s6ER2ov

rt -> rt
@ -> @
daviddoel -> daviddoel
: -> :
so -> so
this -> this
is -> is
why -> why
vincent -> vincent
d'onofrio -> d'onofrio
's -> 's
is -> is
so -> so
good -> good
at -> at
playing -> play
the -> the
disturbed -> disturb
guy -> guy
with -> with
manic -> manic
outbursts -> outburst
. -> .
https -> https
: -> :
//t.co/ov1s6er2ov -> //t.co/ov1s6er2ov

RT @atensnut: Somebody put this crazy B*tch in a straight jacket and take her away from all cameras. https://t.co/x6lnkod3Ok

rt -> rt
@ -> @
atensnut -> atensnut
: -> :
somebody -> somebodi
put -> put
this -> this
crazy -> crazi
b*tch -> b*tch
in -> in
a -> a
straight -> straight
jacket -> jacket
and -> and
take -> take
her -> her
away -> away
from -> from
all -> all
cameras -> camera
. -> .
https -> https
: -> :
//t.co/x6lnkod3ok -> //t.co/x6lnkod3ok

RT @thebradfordfile: Barack Obama’s secretary of state and vice president both used their offices to enrich their families with money from…

rt -> rt
@ -> @
thebradfordfile -> thebradfordfil
: -> :
barack -> barack
obama -> obama
’ -> ’
s -> s
secretary -> secretari
of -> of
state -> state
and -> and
vice -> vice
president -> presid
both -> both
used -> use
their -> their
offices -> offic
to -> to
enrich -> enrich
their -> their
families -> famili
with -> with
money -> money
from… -> from…

RT @BreitbartNews: Alternative headline: Hillary Clinton is STILL Not President...And Never Will Be https://t.co/OHihpuKYOy

rt -> rt
@ -> @
breitbartnews -> breitbartnew
: -> :
alternative -> altern
headline -> headlin
: -> :
hillary -> hillari
clinton -> clinton
is -> is
still -> still
not -> not
president -> presid
... -> ...
and -> and
never -> never
will -> will
be -> be
https -> https
: -> :
//t.co/ohihpukyoy -> //t.co/ohihpukyoy

RT @thebradfordfile: Clinton Foundation contributions:

2015: $183 million
2016: $135 million
2017:   $23 million

Why would foreign govern…

rt -> rt
@ -> @
thebradfordfile -> thebradfordfil
: -> :
clinton -> clinton
foundation -> foundat
contributions -> contribut
: -> :
2015 -> 2015
: -> :
$ -> $
183 -> 183
million -> million
2016 -> 2016
: -> :
$ -> $
135 -> 135
million -> million
2017 -> 2017
: -> :
$ -> $
23 -> 23
million -> million
why -> why
would -> would
foreign -> foreign
govern… -> govern…

RT @RedNationRising: Daily Reminder

Hillary Clinton PAYED British &amp; Russian Government Sources to dig up dirt on candidate Trump so she co…

rt -> rt
@ -> @
rednationrising -> rednationris
: -> :
daily -> daili
reminder -> remind
hillary -> hillari
clinton -> clinton
payed -> pay
british -> british
& -> &
amp -> amp
; -> ;
russian -> russian
government -> govern
sources -> sourc
to -> to
dig -> dig
up -> up
dirt -> dirt
on -> on
candidate -> candid
trump -> trump
so -> so
she -> she
co… -> co…

RT @kylegriffin1: NBC News confirms: Trump sought help from the Australian prime minister to investigate the origins of former special coun…

rt -> rt
@ -> @
kylegriffin1 -> kylegriffin1
: -> :
nbc -> nbc
news -> news
confirms -> confirm
: -> :
trump -> trump
sought -> sought
help -> help
from -> from
the -> the
australian -> australian
prime -> prime
minister -> minist
to -> to
investigate -> investig
the -> the
origins -> origin
of -> of
former -> former
special -> special
coun… -> coun…

RT @StormIsUponUs: Bomb after bomb after bomb. "Clinton kept classified emails on a private server in violation of Federal law, and the imm…

rt -> rt
@ -> @
stormisuponus -> stormisuponus
: -> :
bomb -> bomb
after -> after
bomb -> bomb
after -> after
bomb -> bomb
. -> .
`` -> ``
clinton -> clinton
kept -> kept
classified -> classifi
emails -> email
on -> on
a -> a
private -> privat
server -> server
in -> in
violation -> violat
of -> of
federal -> feder
law -> law
, -> ,
and -> and
the -> the
imm… -> imm…

As Many as 130 Democrat State Department Employees May Lose Security Clearances Because of Hillary Clinton's Bathro… https://t.co/l6B5GzxPsn

as -> as
many -> mani
as -> as
130 -> 130
democrat -> democrat
state -> state
department -> depart
employees -> employe
may -> may
lose -> lose
security -> secur
clearances -> clearanc
because -> because
of -> of
hillary -> hillari
clinton -> clinton
's -> 's
bathro… -> bathro…
https -> https
: -> :
//t.co/l6b5gzxpsn -> //t.co/l6b5gzxpsn

RT @DonaldJTrumpJr: 🤔 https://t.co/nGn0BzbiK8

rt -> rt
@ -> @
donaldjtrumpjr -> donaldjtrumpjr
: -> :
🤔 -> 🤔
https -> https
: -> :
//t.co/ngn0bzbik8 -> //t.co/ngn0bzbik8

RT @thebradfordfile: Barack Obama’s secretary of state and vice president both used their offices to enrich their families with money from…

rt -> rt
@ -> @
thebradfordfile -> thebradfordfil
: -> :
barack -> barack
obama -> obama
’ -> ’
s -> s
secretary -> secretari
of -> of
state -> state
and -> and
vice -> vice
president -> presid
both -> both
used -> use
their -> their
offices -> offic
to -> to
enrich -> enrich
their -> their
families -> famili
with -> with
money -> money
from… -> from…

RT @CIAGoFundMe: Alyssa Milano: how many wines is the right number to drink everyday of impeachment

Hillary clinton’s Twitter intern: you…

rt -> rt
@ -> @
ciagofundme -> ciagofundm
: -> :
alyssa -> alyssa
milano -> milano
: -> :
how -> how
many -> mani
wines -> wine
is -> is
the -> the
right -> right
number -> number
to -> to
drink -> drink
everyday -> everyday
of -> of
impeachment -> impeach
hillary -> hillari
clinton -> clinton
’ -> ’
s -> s
twitter -> twitter
intern -> intern
: -> :
you… -> you…

RT @BaskingBall1: Donal trump in peach? Peach small Trump big how can fit in peach

rt -> rt
@ -> @
baskingball1 -> baskingball1
: -> :
donal -> donal
trump -> trump
in -> in
peach -> peach
? -> ?
peach -> peach
small -> small
trump -> trump
big -> big
how -> how
can -> can
fit -> fit
in -> in
peach -> peach

RT @TheEternal_now: I'm not even a Berner, but this is shameful.

The majority of Bernie's money comes from grassroots contributions. He ha…

rt -> rt
@ -> @
theeternal_now -> theeternal_now
: -> :
i -> i
'm -> 'm
not -> not
even -> even
a -> a
berner -> berner
, -> ,
but -> but
this -> this
is -> is
shameful -> shame
. -> .
the -> the
majority -> major
of -> of
bernie -> berni
's -> 's
money -> money
comes -> come
from -> from
grassroots -> grassroot
contributions -> contribut
. -> .
he -> he
ha… -> ha…

RT @TomFitton: The "whistleblower" complaint is a gussied up illegal leak of classified information and, as such, is evidence of a crime. D…

rt -> rt
@ -> @
tomfitton -> tomfitton
: -> :
the -> the
`` -> ``
whistleblower -> whistleblow
'' -> ''
complaint -> complaint
is -> is
a -> a
gussied -> gussi
up -> up
illegal -> illeg
leak -> leak
of -> of
classified -> classifi
information -> inform
and -> and
, -> ,
as -> as
such -> such
, -> ,
is -> is
evidence -> evid
of -> of
a -> a
crime -> crime
. -> .
d… -> d…

RT @thebradfordfile: Nancy Pelosi: “The president must be held accountable. No one* is above the law."

* except Barack Obama, Hillary Clin…

rt -> rt
@ -> @
thebradfordfile -> thebradfordfil
: -> :
nancy -> nanci
pelosi -> pelosi
: -> :
“ -> “
the -> the
president -> presid
must -> must
be -> be
held -> held
accountable -> account
. -> .
no -> no
one* -> one*
is -> is
above -> above
the -> the
law -> law
. -> .
'' -> ''
* -> *
except -> except
barack -> barack
obama -> obama
, -> ,
hillary -> hillari
clin… -> clin…

JUST NOW: Senator Bernie Sanders tells crowds at New Hampshire rally, “But given the impeachment process that is no… https://t.co/KnCXSUxgaO

just -> just
now -> now
: -> :
senator -> senat
bernie -> berni
sanders -> sander
tells -> tell
crowds -> crowd
at -> at
new -> new
hampshire -> hampshir
rally -> ralli
, -> ,
“ -> “
but -> but
given -> given
the -> the
impeachment -> impeach
process -> process
that -> that
is -> is
no… -> no…
https -> https
: -> :
//t.co/kncxsuxgao -> //t.co/kncxsuxgao

RT @PrisonPlanet: Who rioted after they lost the election?

Hillary Clinton supporters. https://t.co/ABXkZK8bTY

rt -> rt
@ -> @
prisonplanet -> prisonplanet
: -> :
who -> who
rioted -> riot
after -> after
they -> they
lost -> lost
the -> the
election -> elect
? -> ?
hillary -> hillari
clinton -> clinton
supporters -> support
. -> .
https -> https
: -> :
//t.co/abxkzk8bty -> //t.co/abxkzk8bti

RT @Helo1World4Ever: "(USA + US Patriotic Democratic &amp; Republican Party Leaders + John McCain+Ronald Regan+Abraham Lincoln+Martin Luther Ki…

rt -> rt
@ -> @
helo1world4ever -> helo1world4ev
: -> :
`` -> ``
( -> (
usa -> usa
+ -> +
us -> us
patriotic -> patriot
democratic -> democrat
& -> &
amp -> amp
; -> ;
republican -> republican
party -> parti
leaders -> leader
+ -> +
john -> john
mccain+ronald -> mccain+ronald
regan+abraham -> regan+abraham
lincoln+martin -> lincoln+martin
luther -> luther
ki… -> ki…

RT @thebradfordfile: Barack Obama’s secretary of state and vice president both used their offices to enrich their families with money from…

rt -> rt
@ -> @
thebradfordfile -> thebradfordfil
: -> :
barack -> barack
obama -> obama
’ -> ’
s -> s
secretary -> secretari
of -> of
state -> state
and -> and
vice -> vice
president -> presid
both -> both
used -> use
their -> their
offices -> offic
to -> to
enrich -> enrich
their -> their
families -> famili
with -> with
money -> money
from… -> from…

@realDonaldTrump What chasing after Hillary Clinton's personal emails?

@ -> @
realdonaldtrump -> realdonaldtrump
what -> what
chasing -> chase
after -> after
hillary -> hillari
clinton -> clinton
's -> 's
personal -> person
emails -> email
? -> ?

As a non-conformist independent who finds tribal mentality nauseating, I'm having a really hard time determining wh… https://t.co/YTow2DUqm5

as -> as
a -> a
non-conformist -> non-conformist
independent -> independ
who -> who
finds -> find
tribal -> tribal
mentality -> mental
nauseating -> nauseat
, -> ,
i -> i
'm -> 'm
having -> having
a -> a
really -> realli
hard -> hard
time -> time
determining -> determin
wh… -> wh…
https -> https
: -> :
//t.co/ytow2duqm5 -> //t.co/ytow2duqm5

https://t.co/BXM7NFZRHy

https -> https
: -> :
//t.co/bxm7nfzrhy -> //t.co/bxm7nfzrhi

RT @UKTwatter: I don't think we can call ourselves a Democracy, or the "Free world", until we have applied the rule of law to such obvious…

rt -> rt
@ -> @
uktwatter -> uktwatt
: -> :
i -> i
do -> do
n't -> n't
think -> think
we -> we
can -> can
call -> call
ourselves -> ourselves
a -> a
democracy -> democraci
, -> ,
or -> or
the -> the
`` -> ``
free -> free
world -> world
'' -> ''
, -> ,
until -> until
we -> we
have -> have
applied -> appli
the -> the
rule -> rule
of -> of
law -> law
to -> to
such -> such
obvious… -> obvious…

RT @DonaldJTrumpJr: 🤔 https://t.co/nGn0BzbiK8

rt -> rt
@ -> @
donaldjtrumpjr -> donaldjtrumpjr
: -> :
🤔 -> 🤔
https -> https
: -> :
//t.co/ngn0bzbik8 -> //t.co/ngn0bzbik8

#Impeachtrump Trump asked the Australian prime minister to help investigate Mueller probe origins https://t.co/IqsFkiMoyU via @nbcnews

# -> #
impeachtrump -> impeachtrump
trump -> trump
asked -> ask
the -> the
australian -> australian
prime -> prime
minister -> minist
to -> to
help -> help
investigate -> investig
mueller -> mueller
probe -> probe
origins -> origin
https -> https
: -> :
//t.co/iqsfkimoyu -> //t.co/iqsfkimoyu
via -> via
@ -> @
nbcnews -> nbcnew

RT @thebradfordfile: Barack Obama’s secretary of state and vice president both used their offices to enrich their families with money from…

rt -> rt
@ -> @
thebradfordfile -> thebradfordfil
: -> :
barack -> barack
obama -> obama
’ -> ’
s -> s
secretary -> secretari
of -> of
state -> state
and -> and
vice -> vice
president -> presid
both -> both
used -> use
their -> their
offices -> offic
to -> to
enrich -> enrich
their -> their
families -> famili
with -> with
money -> money
from… -> from…

"Hillary Clinton on Women Uncomfortable With Biden Touching Them: ‘Get Over It’"  https://t.co/5eUVgu0cjJ

`` -> ``
hillary -> hillari
clinton -> clinton
on -> on
women -> women
uncomfortable -> uncomfort
with -> with
biden -> biden
touching -> touch
them -> them
: -> :
‘ -> ‘
get -> get
over -> over
it -> it
’ -> ’
'' -> ''
https -> https
: -> :
//t.co/5euvgu0cjj -> //t.co/5euvgu0cjj

RT @EpochTimes: #HillaryClinton dismissed women and girls who have expressed how uncomfortable they became when touched by @JoeBiden.

@Hil…

rt -> rt
@ -> @
epochtimes -> epochtim
: -> :
# -> #
hillaryclinton -> hillaryclinton
dismissed -> dismiss
women -> women
and -> and
girls -> girl
who -> who
have -> have
expressed -> express
how -> how
uncomfortable -> uncomfort
they -> they
became -> becam
when -> when
touched -> touch
by -> by
@ -> @
joebiden -> joebiden
. -> .
@ -> @
hil… -> hil…

RT @ChuckCallesto: FBI now IMPLICATED In Destroying Evidence To Help Hillary Clinton... MEDIA SILENT..

RAISE YOUR HAND IF YOU WANT TO SEE…

rt -> rt
@ -> @
chuckcallesto -> chuckcallesto
: -> :
fbi -> fbi
now -> now
implicated -> implic
in -> in
destroying -> destroy
evidence -> evid
to -> to
help -> help
hillary -> hillari
clinton -> clinton
... -> ...
media -> media
silent.. -> silent..
raise -> rais
your -> your
hand -> hand
if -> if
you -> you
want -> want
to -> to
see… -> see…

RT @thebradfordfile: Barack Obama’s secretary of state and vice president both used their offices to enrich their families with money from…

rt -> rt
@ -> @
thebradfordfile -> thebradfordfil
: -> :
barack -> barack
obama -> obama
’ -> ’
s -> s
secretary -> secretari
of -> of
state -> state
and -> and
vice -> vice
president -> presid
both -> both
used -> use
their -> their
offices -> offic
to -> to
enrich -> enrich
their -> their
families -> famili
with -> with
money -> money
from… -> from…

RT @DonaldJTrumpJr: 🤔 https://t.co/nGn0BzbiK8

rt -> rt
@ -> @
donaldjtrumpjr -> donaldjtrumpjr
: -> :
🤔 -> 🤔
https -> https
: -> :
//t.co/ngn0bzbik8 -> //t.co/ngn0bzbik8

RT @ChadPergram: From colleague Catherine Herridge.  GOP Sens Grassley/Johnson write to AG Barr. Ask about “brazen efforts by the Democrati…

rt -> rt
@ -> @
chadpergram -> chadpergram
: -> :
from -> from
colleague -> colleagu
catherine -> catherin
herridge -> herridg
. -> .
gop -> gop
sens -> sen
grassley/johnson -> grassley/johnson
write -> write
to -> to
ag -> ag
barr -> barr
. -> .
ask -> ask
about -> about
“ -> “
brazen -> brazen
efforts -> effort
by -> by
the -> the
democrati… -> democrati…

RT @BaskingBall1: Donal trump in peach? Peach small Trump big how can fit in peach

rt -> rt
@ -> @
baskingball1 -> baskingball1
: -> :
donal -> donal
trump -> trump
in -> in
peach -> peach
? -> ?
peach -> peach
small -> small
trump -> trump
big -> big
how -> how
can -> can
fit -> fit
in -> in
peach -> peach

RT @KamVTV: Hillary Clinton said on TV President Trump is obsessed with her. Hysterical. 

Hillary Clinton is obsessed with Hillary Clinton…

rt -> rt
@ -> @
kamvtv -> kamvtv
: -> :
hillary -> hillari
clinton -> clinton
said -> said
on -> on
tv -> tv
president -> presid
trump -> trump
is -> is
obsessed -> obsess
with -> with
her -> her
. -> .
hysterical -> hyster
. -> .
hillary -> hillari
clinton -> clinton
is -> is
obsessed -> obsess
with -> with
hillary -> hillari
clinton… -> clinton…

RT @ItoniLl: State Department stepped up Hillary Clinton email probe beginning in August: report

https://t.co/FG2VidxPaC
If Hillary Clinto…

rt -> rt
@ -> @
itonill -> itonil
: -> :
state -> state
department -> depart
stepped -> step
up -> up
hillary -> hillari
clinton -> clinton
email -> email
probe -> probe
beginning -> begin
in -> in
august -> august
: -> :
report -> report
https -> https
: -> :
//t.co/fg2vidxpac -> //t.co/fg2vidxpac
if -> if
hillary -> hillari
clinto… -> clinto…

RT @ChuckCallesto: FBI now IMPLICATED In Destroying Evidence To Help Hillary Clinton... MEDIA SILENT..

RAISE YOUR HAND IF YOU WANT TO SEE…

rt -> rt
@ -> @
chuckcallesto -> chuckcallesto
: -> :
fbi -> fbi
now -> now
implicated -> implic
in -> in
destroying -> destroy
evidence -> evid
to -> to
help -> help
hillary -> hillari
clinton -> clinton
... -> ...
media -> media
silent.. -> silent..
raise -> rais
your -> your
hand -> hand
if -> if
you -> you
want -> want
to -> to
see… -> see…

RT @realDonaldTrump: “Nancy Pelosi and the Democrats can’t put down the Impeachment match. They know they couldn’t beat him in 2016 against…

rt -> rt
@ -> @
realdonaldtrump -> realdonaldtrump
: -> :
“ -> “
nancy -> nanci
pelosi -> pelosi
and -> and
the -> the
democrats -> democrat
can -> can
’ -> ’
t -> t
put -> put
down -> down
the -> the
impeachment -> impeach
match -> match
. -> .
they -> they
know -> know
they -> they
couldn -> couldn
’ -> ’
t -> t
beat -> beat
him -> him
in -> in
2016 -> 2016
against… -> against…

@atensnut @401_9163 How do you tell if Hillary Clinton is lying? Her mouth is moving! I cannot believe she is still spewing her hate!

@ -> @
atensnut -> atensnut
@ -> @
401_9163 -> 401_9163
how -> how
do -> do
you -> you
tell -> tell
if -> if
hillary -> hillari
clinton -> clinton
is -> is
lying -> lie
? -> ?
her -> her
mouth -> mouth
is -> is
moving -> move
! -> !
i -> i
can -> can
not -> not
believe -> believ
she -> she
is -> is
still -> still
spewing -> spew
her -> her
hate -> hate
! -> !

Love it!  Clinton clearly hasn't shown fear of Trump, but he fears her.

love -> love
it -> it
! -> !
clinton -> clinton
clearly -> clear
has -> has
n't -> n't
shown -> shown
fear -> fear
of -> of
trump -> trump
, -> ,
but -> but
he -> he
fears -> fear
her -> her
. -> .

RT @BuckSexton: Hey anyone at @cnn want to take a shot at why donations to the Clinton Foundation fell off a cliff when Hillary lost in 201…

rt -> rt
@ -> @
bucksexton -> bucksexton
: -> :
hey -> hey
anyone -> anyon
at -> at
@ -> @
cnn -> cnn
want -> want
to -> to
take -> take
a -> a
shot -> shot
at -> at
why -> why
donations -> donat
to -> to
the -> the
clinton -> clinton
foundation -> foundat
fell -> fell
off -> off
a -> a
cliff -> cliff
when -> when
hillary -> hillari
lost -> lost
in -> in
201… -> 201…

RT @dylanmsmitty: It is repugnant. Disgusting. Cowardly. To threaten civil war as a sitting president? Donald Trump cares only about self p…

rt -> rt
@ -> @
dylanmsmitty -> dylanmsmitti
: -> :
it -> it
is -> is
repugnant -> repugn
. -> .
disgusting -> disgust
. -> .
cowardly -> coward
. -> .
to -> to
threaten -> threaten
civil -> civil
war -> war
as -> as
a -> a
sitting -> sit
president -> presid
? -> ?
donald -> donald
trump -> trump
cares -> care
only -> only
about -> about
self -> self
p… -> p…

Upcoming tasks¶

In the following weeks I will need to gather more tweets, find an appropriate way to get the chunks of the words and to find those words in the tweets therefore create the graph.

	contributors	coordinates	created_at	display_text_range	entities	extended_tweet	favorited	filter_level	geo	...	quoted_status_permalink	retweeted	retweeted_status	source	text	timestamp_ms	truncated	user
0	None	None	Thu Sep 19 11:12:50 +0000 2019	NaN	{'hashtags': [], 'urls': [], 'user_mentions': ...	NaN	False	low	None	...	NaN	False	{'created_at': 'Tue Sep 17 22:30:05 +0000 2019...	<a href="http://twitter.com/download/iphone" r...	RT @seanhannity: **Move over FBI, James Comey,...	1568891570649	False	{'id': 108675976, 'id_str': '108675976', 'name...
1	None	None	Thu Sep 19 11:12:51 +0000 2019	NaN	{'hashtags': [], 'urls': [{'url': 'https://t.c...	{'full_text': 'To everybody breathlessly waiti...	False	low	None	...	NaN	False	NaN	<a href="https://mobile.twitter.com" rel="nofo...	To everybody breathlessly waiting for the next...	1568891571304	True	{'id': 21390418, 'id_str': '21390418', 'name':...
2	None	None	Thu Sep 19 11:12:52 +0000 2019	NaN	{'hashtags': [], 'urls': [], 'user_mentions': ...	NaN	False	low	None	...	NaN	False	{'created_at': 'Thu Sep 19 02:41:51 +0000 2019...	<a href="http://twitter.com/#!/download/ipad" ...	RT @RyanAFournier: Democratic megadonor Ed Buc...	1568891572477	False	{'id': 821529902805643264, 'id_str': '82152990...
3	None	None	Thu Sep 19 11:12:52 +0000 2019	NaN	{'hashtags': [], 'urls': [], 'user_mentions': ...	NaN	False	low	None	...	NaN	False	{'created_at': 'Wed Sep 18 21:23:58 +0000 2019...	<a href="http://twitter.com/download/android" ...	RT @TalbertSwan: Barack Obama: 8 yrs\n\n0 indi...	1568891572528	False	{'id': 55573445, 'id_str': '55573445', 'name':...
4	None	None	Thu Sep 19 11:12:53 +0000 2019	NaN	{'hashtags': [], 'urls': [], 'user_mentions': ...	NaN	False	low	None	...	NaN	False	{'created_at': 'Wed Sep 18 19:41:51 +0000 2019...	<a href="http://twitter.com/download/iphone" r...	RT @dbongino: One of the worst acts of media m...	1568891573644	False	{'id': 4606622202, 'id_str': '4606622202', 'na...