[Gephi-plugins] Plugin for realtime graph generation based on web browsing

T B phreakocious at gmail.com
Thu Dec 9 05:25:57 CET 2010


Switched from LittleProxy to Membrane:
http://www.membrane-soa.org/soap-monitor/  Haven't had any issues..

Launchpad updated, new NBM at
http://phreakocious.net/dev/net-phreakocious-httpgraph.nbm

Looking forward to hearing any feedback.


On Tue, Dec 7, 2010 at 11:28 PM, T B <phreakocious at gmail.com> wrote:

> Thanks, it has been stretching my Java abilities a bit.  I wasn't able to
> rewrite it with Import as you suggest, but was able to get something mostly
> functional from the advice.  This is still a Generator, but it stays alive
> in the background updating the workspace until the app is closed.  All you
> have to do is (install plugin), pick New Project, File/Generate/HttpGraph,
> set your browser's proxy for 127.0.0.0:8088 (or whatever port), and browse
> the web.
>
> Some issues:
> Strange nodes with incomplete information
> Nodes without edges??
> Highly complex web sites (Google maps, for example) will bring everything
> to a grinding halt
>
> Code available at: lp:~phreakocious/gephi/httpgraph
> NBM at: http://phreakocious.net/dev/net-phreakocious-httpgraph.nbm
>
> Merci beaucoup!
>
>
>
> On Mon, Dec 6, 2010 at 11:43 PM, Mathieu Bastian <
> mathieu.bastian at gmail.com> wrote:
>
>> That is cool stuff!
>>
>> Yeah Generator is not the best place for doing that. I would recommend to
>> use Import directly, but woithout UI, to discard displaying the import
>> report. As you were trying to do this with Generator you are probably
>> already familiar with the container. Here is how to create, fill and append
>> a container into the current workspace.
>>
>> //Get Currennt workspace
>> ProjectController pc =
>> Lookup.getDefault().lookup(ProjectController.class);
>> Workspace workspace = pc.getCurrentWorkspace();
>>
>> //Get container
>> Container container =
>> Lookup.getDefault().lookup(ContainerFactory.class).newContainer();
>>
>> //Append container to current graph
>> ImportController importController =
>> Lookup.getDefault().lookup(ImportController.class);
>> importController.process(container, new AppendProcessor(), workspace);
>>
>> Mathieu
>>
>> On Mon, Dec 6, 2010 at 7:24 PM, T B <phreakocious at gmail.com> wrote:
>>
>>> A bit more information..
>>>
>>> Adding a 20 second sleep() to the generate() function results in 20
>>> seconds of data collected, so this seems like the wrong place for real time
>>> updating. =)  Advice would be really helpful at this point.
>>>
>>> Here's an example from my Perl/Streaming solution of some gephi.org and
>>> wiki.gephi.org browsing:
>>> http://phreakocious.net/dev/httpgraph.gephi
>>> [image: httpgraph.png]
>>>
>>>
>>> On Mon, Dec 6, 2010 at 1:29 PM, T B <phreakocious at gmail.com> wrote:
>>>
>>>> Gephi devs,
>>>>
>>>> The idea is to stream data about your web browsing directly into Gephi
>>>> in real-time.
>>>>
>>>> After successfully proving out the concept with a Perl script and the
>>>> Streaming plugin, I'm trying to implement it in Java.  I've embedded
>>>> LittleProxy (http://www.littleshoot.org/littleproxy/) and extended a
>>>> few classes to collect the necessary data and now need to create the
>>>> appropriate nodes/edges on the graph.
>>>>
>>>> Currently trying to do this as a Generator, but running into some
>>>> problems.  Because this would run indefinitely in the background, the
>>>> controlling thread that updates the graph needs to be around whenever new
>>>> updates are available, but this doesn't seem to be the way that the
>>>> Generator class works.  Does it make more sense to do this as an Import?
>>>>
>>>> I'd appreciate any feedback you might have as I'm really close to having
>>>> this done!
>>>>
>>>> Thanks!
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>> _______________________________________________
>>> gephi-plugins mailing list
>>> gephi-plugins at lists.gephi.org
>>> http://gephi.org/mailman/listinfo/gephi-plugins
>>>
>>>
>>
>> _______________________________________________
>> gephi-plugins mailing list
>> gephi-plugins at lists.gephi.org
>> http://gephi.org/mailman/listinfo/gephi-plugins
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gephi.org/pipermail/gephi-plugins/attachments/20101208/3161dc7a/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: httpgraph.png
Type: image/png
Size: 167162 bytes
Desc: not available
URL: <http://gephi.org/pipermail/gephi-plugins/attachments/20101208/3161dc7a/attachment-0001.png>


More information about the gephi-plugins mailing list