Word Tree Generator
Throughout fall 2019, I worked on a script to pull news articles form RSS feeds, parsing them to get a chain of words (similar to ngram) which can then graphed by frequency. Next steps with this project was to use the network to rebuild sentences that many articles had in common, creating a “summary” of a group of articles. This works better using custom RSS feeds to get articles that are already similar.
Sample output
Number of Links: 38
Trump's impeachment trial is over but the politics are not - CNN
------------------------------------------------------------
Trump Fans Flooded Iowa Caucus Hotline, Democrats Say - Bloomberg
------------------------------------------------------------
Coronavirus Live Updates: Soaring Death Toll in China and Run on Stores in Hong Kong - The New York Times
------------------------------------------------------------
China halves tariffs on $75 billion worth of US goods, as coronavirus outbreak escalates - CNN
------------------------------------------------------------
WHO says coronavirus cases surge: 'Most cases in a single day' - CNBC
------------------------------------------------------------
Joe Biden snags endorsement from electrical workers union - The Washington Post
------------------------------------------------------------
Kobe crash: Vanessa Bryant posts another heartbreaking message on Instagram - NJ.com
------------------------------------------------------------
Ponzi scheme king Bernie Madoff, who bilked investors out of billions, seeks medical release from prison - The Washington Post
------------------------------------------------------------
Parkland Dad Apologizes for State of the Union Outburst - Snopes.com
------------------------------------------------------------
Former top Obama adviser praises Trump's 'very well-crafted' State of the Union address - Fox News
------------------------------------------------------------
Plane Breaks Apart In A Turkish Field, Killing 3 And Injuring Nearly 179 - NPR
------------------------------------------------------------
Trump Gives Venezuela’s Guaidó the Embrace He Wanted - The New York Times
------------------------------------------------------------
U.S. Troops in Standoffs With Russian Military Contractors in Syria - The Wall Street Journal
------------------------------------------------------------
Senate acquits Trump on impeachment charges, rejecting calls for his removal in historic trial - CBS News
------------------------------------------------------------
Dow books nearly 500-point gain as S&P 500 and Nasdaq close at records - MarketWatch
------------------------------------------------------------
China wants to patent Gilead's experimental coronavirus drug - msnNOW
------------------------------------------------------------
Casper is no longer a unicorn after pricing its IPO at $12 a share - Business Insider - Business Insider
------------------------------------------------------------
Adopting a dog? Coors Light offering $100 toward dog adoption fees for Valentine's Day - USA TODAY
------------------------------------------------------------
The top free app on the UK Play Store is scamming users into paid subscriptions (Updated) - Android Police
------------------------------------------------------------
Motorola Razr teardown looks inside the flexible phone - Engadget
------------------------------------------------------------
Microsoft to combine its Windows client and hardware teams under Chief Product Officer Panos Panay - ZDNet
------------------------------------------------------------
Netflix begins streaming AV1 content on its Android mobile app - Neowin
------------------------------------------------------------
Kirk Douglas, Actor and Hollywood Legend, Dead at 103 - TMZ
------------------------------------------------------------
Jessica Simpson says Joe Simpson 'betrayed' his marriage to her mother - Page Six
------------------------------------------------------------
Piers Morgan Hates and Loves On Shakira and Jennifer Lopez's Super Bowl Performances - Showbiz Cheat Sheet
------------------------------------------------------------
Harvey Weinstein trial: attorney shows dress witness wore during alleged attack - The Guardian
------------------------------------------------------------
Sources: Prospect's health holds up 3-team trade involving Mookie Betts - ESPN
------------------------------------------------------------
UFC 247: Meet the Challengers - UFC - Ultimate Fighting Championship
------------------------------------------------------------
Travis Kelce's Super Bowl speech took a shot at Dee Ford's crucial 2019 offsides penalty - Overwatch Wire
------------------------------------------------------------
In the Deal to Sell the Mets, a Snag Fits a Familiar Pattern - The New York Times
------------------------------------------------------------
NASA's Koch: After 328 days in space, extensive tests await her - Aljazeera.com
------------------------------------------------------------
Full moon: February's supermoon, known as the Snow Moon, will illuminate the night sky this weekend - CBS News
------------------------------------------------------------
Images obtained of two stars in the process of a merger - Ars Technica
------------------------------------------------------------
Trump touts Space Force in State of the Union address - Livescience.com
------------------------------------------------------------
Wisconsin's first case of new coronavirus from China is resident of Dane County - Madison.com
------------------------------------------------------------
More Americans evacuated from China as CDC confirms 12th U.S. case of coronavirus - NBC News
------------------------------------------------------------
Two coronavirus patients transferred to UC San Francisco - SF Gate
------------------------------------------------------------
Patient under investigation for possible coronavirus case in Beaumont, health official say - KPRC Click2Houston
------------------------------------------------------------
Donwloaded articles
Words: 10910
Unique Words: 4422
Adding nodes and paths...
Generating full network...