tag:dreamwidth.org,2009-02-18:280 Crunching that data Memewidth 2009-08-22T07:17:53Z tag:dreamwidth.org,2009-02-18:280:3466 foxfirefey 2009-08-22T07:17:53Z 2009-08-22T07:17:53Z public 0 Posted by: <span lj:user='foxfirefey' style='white-space: nowrap;' class='ljuser'><a href='https://foxfirefey.dreamwidth.org/profile'><img src='https://www.dreamwidth.org/img/silk/identity/user.png' alt='[personal profile] ' width='17' height='17' style='vertical-align: text-bottom; border: 0; padding-right: 1px;' /></a><a href='https://foxfirefey.dreamwidth.org/'><b>foxfirefey</b></a></span><br /><br />For people who want to learn how to do natural language processing, the <a href="http://www.nltk.org/">NLTK</a> library has a CC'd book, <a href="http://www.nltk.org/book">Natural Language Processing with Python</a>. Might be a useful resource for people wanting to make things based off of people's post content.<br /><br /><img src="https://www.dreamwidth.org/tools/commentcount?user=memewidth&ditemid=3466" width="30" height="12" alt="comment count unavailable" style="vertical-align: middle;"/> comments tag:dreamwidth.org,2009-02-18:280:1828 foxfirefey 2009-04-11T08:59:06Z 2009-04-11T08:59:06Z public 0 Posted by: <span lj:user='foxfirefey' style='white-space: nowrap;' class='ljuser'><a href='https://foxfirefey.dreamwidth.org/profile'><img src='https://www.dreamwidth.org/img/silk/identity/user.png' alt='[personal profile] ' width='17' height='17' style='vertical-align: text-bottom; border: 0; padding-right: 1px;' /></a><a href='https://foxfirefey.dreamwidth.org/'><b>foxfirefey</b></a></span><br /><br />I've released the library that I made to create LJ relationship graphs. It uses <a href="http://networkx.lanl.gov/index.html">NetworkX</a> which uses <a href="http://matplotlib.sourceforge.net/">matplotlib</a>. It's fairly rudimentary, but sufficient for a simple graph of people an account has friended who've friended each other, with the size of the dots scaled to the number of mutual friends that person has.<br /><br /><span class="cut-wrapper"><span style="display: none;" id="span-cuttag___1" class="cuttag"></span><b class="cut-open">(&nbsp;</b><b class="cut-text"><a href="https://memewidth.dreamwidth.org/1828.html#cutid1">small example</a></b><b class="cut-close">&nbsp;)</b></span><div style="display: none;" id="div-cuttag___1" aria-live="assertive"></div><br /><br />The functions in the package also provide some nice functionality for on the fly processing (ie, figuring out who do X and Y have friended in common). There's a fdata download and caching manager (default refresh rate: 2 weeks), and it rate limits its requests, so you don't have to be concerned about being hard on the servers when running it.<br /><br />It can be <a href="http://bitbucket.org/foxfirefey/ljminion/">found on BitBucket</a>. I'm not too familiar with Python yet, though I have been enjoying it immensely, so anybody who Knows Better on how to do things is free to give me a guiding poke.<br /><br /><img src="https://www.dreamwidth.org/tools/commentcount?user=memewidth&ditemid=1828" width="30" height="12" alt="comment count unavailable" style="vertical-align: middle;"/> comments