Complex Insight - Understanding our world
10.6K views | +0 today
Follow
Complex Insight  - Understanding our world
Latest news on complex systems in life sciences, engineering, education and government
Curated by ComplexInsight
Your new post is loading...
Your new post is loading...
Scooped by ComplexInsight
Scoop.it!

Big Data on Heroku – Hadoop from Treasure Data

Big Data on Heroku – Hadoop from Treasure Data | Complex Insight  - Understanding our world | Scoop.it

Heroku is a cloud platform as a service (PaaS) owned by Salesforce.com. Heroku supports a range of programming languages for SaaS deployment and a long list of addons including – among others – RDBMS and NoSQL capabilities and Hadoop-based data warehouse developed by Treasure Data. This is a good introductory article on getting started with Heroku and TreasureData Hadoop map-reduce solution. Click on the image or the title to learn more...

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

Apache Accumulo

The Apache Accumulo™ sorted, distributed key/value store is a robust, scalable, high performance data storage and retrieval system. Apache Accumulo is based on Google's BigTable design and is built on top of Apache Hadoop, Zookeeper, and Thrift. Apache Accumulo features a few novel improvements on the BigTable design in the form of cell-based access control and a server-side programming mechanism that can modify key/value pairs at various points in the data management process. Click on title to learn more..

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

Pragmatic Programming Techniques: BIG Data Analytics Pipeline

Pragmatic Programming Techniques: BIG Data Analytics Pipeline | Complex Insight  - Understanding our world | Scoop.it

Good article by Ricky Ho on big data analytics architecture patterns. going from typical data processing pipeline through to basic large scale data analytics architecture and implrementation architectures. Worth reading - click on image or title for more information.

more...
No comment yet.
Rescooped by ComplexInsight from Papers
Scoop.it!

Programmable single-cell mammalian biocomputers

Synthetic biology has advanced the design of standardized control devices that program cellular functions and metabolic activities in living organisms. Rational interconnection of these synthetic switches resulted in increasingly complex designer networks that execute input-triggered genetic instructions with precision, robustness and computational logic reminiscent of electronic circuits (...) we have designed a set of synthetic transcription–translation control devices that could be rewired in a plug-and-play manner

 

Programmable single-cell mammalian biocomputers

Simon Ausländer, David Ausländer, Marius Müller, Markus Wieland & Martin Fussenegger

Nature 487, 123–127 (05 July 2012) http://dx.doi.org/10.1038/nature11149


Via Complexity Digest
more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

New Data Visualization Tool Helps Find the “Unknown Unknowns”

A research team at the Georgia Tech Research Institute (GTRI) has developed a software tool that enables users to perform in-depth analysis of modeling and simulation data, then visualize the results on screen. The new data analysis and visualization tool offers improved ease of use compared to similar tools, the researchers say, and could be readily adapted for use with existing data sets in a variety of disciplines to help identify hidden relationships and unknowns within the simulation.  The data analysis and visualization tool is a subset of the Test Matrix Tool (TMT). The new visualization capability offers a graphical user interface that provides both on-screen data-manipulation features like filters and the ability to see query results in the form of graphical images almost instantly. Click on the title to learn more.

more...
No comment yet.
Rescooped by ComplexInsight from 4D Pipeline - trends & breaking news in Visualization, Virtual Reality, Augmented Reality, 3D, Mobile, and CAD.
Scoop.it!

How To Create A Minimum Viable Product

How To Create A Minimum Viable Product | Complex Insight  - Understanding our world | Scoop.it

Timely catch from jed Fisher since we are working on next gen of our products - this has a lot of really good informaiton if you are building webservices. If you are developing products - its a good overview of how web app development is changing and what to use for billing, scaling, HTML and javascript frameworks etc. Worth reading - to find out more click on the image or click on the title... 


Via Jed Fisher
more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

R3 Map Reduce framework by heynemann

R3 Map Reduce framework by heynemann | Complex Insight  - Understanding our world | Scoop.it

r⊃3; is a map reduce engine written in python using a redis backend. It's purpose is to be simple and easy to set up. r⊃3; has only three concepts to grasp: input streams, mappers and reducers.

 

On first glance  - looks useful. Click on image or headline to learn more...

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

Simperium: New Service for migrating data

Simperium: New Service for migrating data | Complex Insight  - Understanding our world | Scoop.it

. Simperium can move data to and from your own backend services to give you complete control. Host your own services or use providers like Heroku to mirror your data, perform analytics, validate changes, send notifications and more. Works great with other services like Twilio and Urban Airship. IF you have need to do this  then Simperium might be of interest. Click on image or title to learn more.

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

How to Mine Unstructured Data - Information Management Newsletters Article

How to Mine Unstructured Data - Information Management Newsletters Article | Complex Insight  - Understanding our world | Scoop.it

Mining Unstructured Data: Difficult, but Not Impossible. Interesting highlevel overview of steps to mine unstructured data for analysis.

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

pywrapper 0.1 : Python Package Index

If you use  Key-Value Data stores   (Memcached, Redis, TokyoTyrant ...) then PyWrapper will be of interest.

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

Google's compute engine versus Microsoft Azure

If you are looking at hosting costs for cloud computing it quickly gets really complicated to make comparisons. Great article on thenextweb.com compares Google's compute engine eith Microsoft Azure. If you need the details - read the article. Takeaway for linux hosting compute cycles are similarly priced - Google is slightly cheaper and offers a lot more RAM than Microsoft machines. So if you are doing Memory intensive compute and need cloud - Google Compute Engine is the way to go for now. Click on the title for more info.

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

Google Fusion Tables API Changes

Google Fusion Tables API Changes | Complex Insight  - Understanding our world | Scoop.it

Google Fusion Tables is a data visualization web application that you can use to work with large data tables to extract meaningful information.
Fusion Tables lets you store, share, query, and visualize data tables. It has a REST API that you can use to manage tables, and a query facility that can be used to manage data rows (insert/update/delete), and query the table for all rows that match spatial or data conditions. Google has announced the public availability of its new Fusion Tables API and at the same has begun a six-month deprecation period for the SQL API. So developers need to start to move over to Fusion Tables soon. Click headline or image to learn more...

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

python quick multiprocessing

If you are coding in python and need either  (or both) local and remote concurrency and want a way to effectively side-stepping the Global Interpreter Lock by using subprocesses instead of threads then the python  multiprocessing package is just the answer you are looking for. Click title to learn more.

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

Distributed Systems with ZeroMQ | Javalobby

Distributed Systems with ZeroMQ | Javalobby | Complex Insight  - Understanding our world | Scoop.it

A chunk of our internal research work is based on distributed processing and distributed simulation. ZeroMQ is a rapidly becoming a key element to rapidly build distributed systems. ZeroMQ is that it's not a message broker like you might assume from its name. ZeroMQ is a library that supports certain network communication patterns using sockets. The "MQ" part comes in because ZeroMQ uses queues internally to buffer messages so that you don't block your application when sending data - which helps in scalability. Rick Copeland has a really good introduction to ZeroMQ on the DZOne. Worth reading. click on the image or title to learn more.

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

Open Source Technologies: Improving Code Quality - LCOM4 and Cyclomatic Complexity

Technical debt represents the skeletons in a software development project's closet. Tools like Sonar give you access to metrics like LCOM4 and cyclomatic complexity. This article provides a great over view of why you should care about these metrics when managing a code base and insight into how to use the tools to see where code needs to be refactored and to gain insight  into which engineers are really delivering versus those producing difficult to maintain code.

Worth reading - click on title for more info.

more...
No comment yet.
Rescooped by ComplexInsight from The Robot Times
Scoop.it!

Seth Lloyd on Programming the Universe

Seth Llyod is a Professor in the Department of Mechanical Engineering at the Massachusetts Institute of Technology (MIT). His talk, "Programming the Universe", is about the computational power of atoms, electrons, and elementary particles.


Via Szabolcs Kósa, The Robot Launch Pad
more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

complexity invented in 1965, Turing and sampling ...

complexity invented in 1965, Turing and sampling ... | Complex Insight  - Understanding our world | Scoop.it
The ACM hosts forum in which lectures from its Turing Award winners are delivered, to the illustrious. See http://amturing.acm.org/lectures.cfm. In short, only in 1965 was the domain of “computational complexity” invented (by ...
more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

Standards and data flows - OBASHI Think

Standards and data flows - OBASHI Think | Complex Insight  - Understanding our world | Scoop.it

I have a lot of time for the OBASHI team blogs- usualyl because the often state that rare commodity - common sense. This post from Paul Wallis - is typical and if you are involved in systems mapping worth reading. One of the best places to look for data flow mapping is within the process industries, where successful product flow is critical to business success. Every system and asset change is viewed and analysed, with flow at the heart of the decision making process.

Taking a process industry concept of how to document, model and analyse flow, and applying it to IT, might just be the answer to creating a standard for data flows.After all, in the process world, a loss of product flow is seen as critical.As modern businesses come to rely more and more on flows of data, a loss of data flow will become just as critical. Lot of good sense packaged here. Click on image or title to learn more...

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

A view from Norway on the Internet of Things

A view from Norway on the Internet of Things | Complex Insight  - Understanding our world | Scoop.it

Nordic - a Norwegian fabless semiconductor company has become one of the first with its nRF51 family to create SoCs that combine ARM cores and 2.4 GHz RF transceivers, optimized for Internet of Things (IoT) markets. Whether Nordic can hold on for what could be a wild ride ahead will be one of the interesting stories to tell in the evolution of the next big thing in the tech industry. Certainly their initial offering has a lot for sensor networks designers to think about. Click on image or title to learn more.

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

MidSens'12

MidSens'12 The seventh international workshop on Middleware Tools, Services and Run-time Support for Sensor Networks (MidSens’12) will be co-located with MIddleware 2012 in Montreal canada. Event runs between December 3rd and 7th 2012.

 

Import­ant Dates:

 

Paper Sub­mis­sion dead­line: August 15, 2012
Accept­ance noti­fic­a­tion: Septem­ber 21, 2012
Author regis­tra­tion dead­line: Octo­ber 5, 2012
Camera-ready ver­sion due: Octo­ber 5, 2012
Work­shop: Decem­ber 3–7, 2012

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

Faculty Summit 2012 - Microsoft Research

Faculty Summit 2012 - Microsoft Research | Complex Insight  - Understanding our world | Scoop.it

Microsoft Research will present its Faculty Summit accessible by the public. On July 16 and 17, 9:00 a.m. to 2:00 p.m. Pacific Standard Time (PST) (noon to 5:00 p.m. Eastern Standard Time). The summit gives an opportunity to hear leading academic researchers and educators, as well as Microsoft researchers, product group engineers, and architects explore new opportunities in computer science research and advances that address real-world challenges. Should be at least and hopefully awesome.  Click on the image or title to learn more.

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

Céu + Wireless Sensor Networks

Céu + Wireless Sensor Networks | Complex Insight  - Understanding our world | Scoop.it

Wireless Sensor Networks (WSNs) are composed of tiny devices (known as “motes”) that sense the environment and communicate via radio. The Synchronous Blog has a great demo using a fixed ring topology with three motes placed side by side within their radio ranges. The motes  follow the same behavior: receive a message with an integer counter, show it on the leds, wait for 1 second, increment the counter, and forward it to the mote on its right. The demo code is less than 70 lines of code and shows how to use parallel compositions and communication via internal events to achieve the intended behavior.

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

Google introduces Compute Engine, Google-scale Linux virtualization

From ArsTechnica: Google has announced a new cloud service Compute Engine, offering large-scale Linux virtualization on Google's infrastructure.

Google boasts that Compute Engine offers up to 50 percent more compute power per dollar than competing IaaS offerings. For applications with low bandwidth and I/O demands, Compute Engine can offer hundreds of thousands of cores; Google demonstrated a genetic application running on 600,000 cores. 

more...
No comment yet.
Scooped by ComplexInsight
Scoop.it!

Parallel Processing of File Data With Scala

Nice Scala example using BufferedSource to read lines from stdin as a buffered source, and also parallelize without the need to hold the entire dataset in memory. Click on headline to learn more...

more...
No comment yet.