Public Datasets - Open Data -
9.5K views | +0 today
Follow
Public Datasets - Open Data -
Your new post is loading...
Your new post is loading...
Scooped by luiy
Scoop.it!

Is Cape Town's new #opendata portal any good? | #dataviz

Is Cape Town's new #opendata portal any good? | #dataviz | Public Datasets - Open Data - | Scoop.it
Code4SA's Adi Eyal takes a look at Africa's first open data city.
luiy's insight:

 ... the City chose to build their portal in-house rather than using one of the existing platforms. The UK open data portal for instance uses an open source platform CKAN. A commercial offering called Socrata is also available if you feel like you need the security of using a closed source solution. The benefit of using an existing platform is that you’re benefiting from the wisdom of those who came before you. It is also often much cheaper than doing it on your own. Our own modest data portal uses Socrata. As a developer, for me the killer feature here is that every dataset comes packaged with a pre-built API and documentation. It also allows non-technical users to create graphs and maps without having to download the data and opening up the spreadsheets. The City’s website in contrast, is not much more than a collection of links.

more...
No comment yet.
Rescooped by luiy from Social Network Analysis #sna
Scoop.it!

#Bitcoin Transaction Network #Dataset | #datamodel

#Bitcoin Transaction Network #Dataset | #datamodel | Public Datasets - Open Data - | Scoop.it

Click here to edit the title


Via ukituki
luiy's insight:

1.  Overview:

 

Bitcoin (bitcoin.org) is a digital, cryptographically secure currency. Transactions between public-key "addresses" maintained in a distributed, verified public ledger form a transaction network that can be studied by network scientists. This code processes binary-format Bitcoin .dat files generated by the Bitcoin client (bitcoin.org, tested on v0.5.3.1 or lower) into human-readable flat-file formats, retaining all available information. Furthermore, we provide a data model to facilitate storage and querying in a relational database. 

 

 

 

2.  Bitcoin transaction overview:

 

The bitcoin digital currency allows users to securely prove ownership of a portion of coins that cascade through the network as a chain of re-assigned ownershiptransactions over time.A transaction on the bitcoin network is a many-to-many function, executed by a user who has ownership to (potentially many) outputs of previous transactions; the user takes this owned value and writes ownership to (potentially many) output nodes (users, represented by addresses in the network).

more...
No comment yet.
Scooped by luiy
Scoop.it!

X-RIME: #Hadoop based large scale social network analysis | #bigdata #SNA

luiy's insight:

Today's Internet-based social network sites possess huge user communities. They hold large amount of data about their users and want to generate core competency from the data. A key enabler for this is a cost efficient solution for social data management and social network analysis (SNA). 

Such a solution faces a few challenges. The most important one is that the solution should be able to handle massive and heterogeneous data sets. Facing this challenge, the traditional data warehouse based solutions are usually not cost efficient enough. On the other hand, existing SNA tools are mostly used in single workstation mode, and not scalable enough. To this end, low cost and highly scalable data management and processing technologies from cloud computing society should be brought in to help. 

However, most of existing cloud based data analysis solutions are trying to provide SQL-like general purpose query languages, and do not directly support social network analysis. This makes them hard to optimize and hard to use for SNA users. So, we came up with X-RIME to fix this gap. 

So, briefly speaking, X-RIME wants to provide a few value-added layers on top of existing cloud infrastructure, to support smart decision loops based on massive data sets and SNA. To end users, X-RIME is a library consists of Map-Reduce programs, which are used to do raw data pre-processing, transformation, SNA metrics and structures calculation, and graph / network visualization. The library could be integrated with other Hadoop based data warehouses (e.g., HIVE) to build more comprehensive solutions.

more...
No comment yet.
Scooped by luiy
Scoop.it!

Immersion: a people-centric view of your email life | #SNA #tools #SNA_INDATCOM

Immersion: a people-centric view of your email life | #SNA #tools #SNA_INDATCOM | Public Datasets - Open Data - | Scoop.it
luiy's insight:
What is Immersion? It has been almost two decades since the beginning of the web. This means that the web is no longer just a technology of the present, but also, a record of our past. 

Email, one of the original forms of social media, is even older than the web and contains a detailed description of our personal and professional history. Immersion is an invitation to dive into the history of your email life in a platform that offers you the safety of knowing that you can always delete your data. Just like a cubist painting, Immersion presents users with a number of different perspectives of their email data. 
It provides a tool for self-reflection at a time where the zeitgeist is one of self-promotion. 
It provides an artistic representation that exists only in the presence of the visitor. 
It helps explore privacy by showing users data that they have already shared with others. 
Finally, it presents users wanting to be more strategic with their professional interactions, with a map to plan more effectively who they connect with. So Immersion is not about one thing. It’s about four. It’s about self-reflection, art, privacy and strategy. It’s about providing users with a number of different perspectives by leveraging on the fact that the web, and emails, are now an important part of our past.

 

 

 

Once you log in, Immersion will use only the From, To, Cc and Timestamp fields of the emails in the account you are signing in with. It will not access the subject or the body content of any of your emails.

 

Upon logging out of Immersion, you will be presented with a choice to save or delete your data, which contains your compressed email metadata and user profile. If you decide to save your email metadata with Immersion, that data will be stored in a secure system. You can always return to the site remotely and delete it at a later time, if you wish to do so.
If you take a snapshot of your Immersion network, the snapshot link will be accessible for 30 days, after which it will be deleted from our server.

more...
No comment yet.
Scooped by luiy
Scoop.it!

The First Interactive Network and Graph Data #Repository with Interactive Graph Analytics and Visualization | #opendata #SNA

The First Interactive Network and Graph Data #Repository with Interactive Graph Analytics and Visualization | #opendata #SNA | Public Datasets - Open Data - | Scoop.it
The First Interactive Network Data Repository with Real-time Interactive Visualization and Analytics
luiy's insight:

Network Data Repository. Exploratory Analysis & Visualization.

 

A network and graph data repository containing hundreds of real-world networks and benchmark datasets. This large comprehensive collection of network graph data is useful for making significant research findings as well as benchmark data sets for machine learning and network science. All data sets are easily downloaded into a standard consistent format. We also have built a multi-level interactive graph analytics engine that allows for visualizing the structure of networks as well as many global graph statistics and local node level properties. 

more...
No comment yet.
Scooped by luiy
Scoop.it!

Graph databases list | #open #gephi #FlockDB #SNA

Graph databases list | #open #gephi #FlockDB #SNA | Public Datasets - Open Data - | Scoop.it
luiy's insight:

Graph databases use graph structures (a finite set of ordered pairs or certain entities), with edges, properties and nodes for data storage. It provides index-free adjacency, meaning that every element is directly linked to its neighbour element. No index lookups are necessary. Graph database are faster when it comes to associative data set compared to relational databases. As they do not need join operations, they can scale naturally to large data sets.

more...
No comment yet.
Scooped by luiy
Scoop.it!

The #Elgg Community: #Oycib. Inteligencia Colectiva | #open #SNA #gephi

The #Elgg Community: #Oycib. Inteligencia Colectiva | #open #SNA #gephi | Public Datasets - Open Data - | Scoop.it
luiy's insight:

#Oycib en ELGG Community. ELGG + Gephi + n

more...
No comment yet.