FrenchTech SAAS
33.5K views | +2 today
FrenchTech SAAS
Les news de l'univers SAAS et FrenchTech
Curated by Mickael Ruau
Your new post is loading...
Your new post is loading...

Popular Tags

Scooped by Mickael Ruau
December 3, 2013 3:20 AM
Scoop.it!

SAP Power AMC sort en version 16.5, l'outil de modélisation de données et d'architecture d'entreprise supporte Windows 8 et s'intègre à BO

SAP Power AMC sort en version 16.5, l'outil de modélisation de données et d'architecture d'entreprise supporte Windows 8 et s'intègre à BO | FrenchTech SAAS | Scoop.it
SAP Power AMC sort en version 16.5 l'outil de modélisation de données et d'architecture d'entreprise supporte de Windows 8 et s'intègre à BO Power AMC/Designer, l'outil de modélisation de données et d'architecture d'entreprise développé par SAP,...
No comment yet.
Scooped by Mickael Ruau
December 3, 2013 2:56 AM
Scoop.it!

Dossier : Quand choisir MySQL ou NoSQL ? - L'œil de Skilly

Dossier : Quand choisir MySQL ou NoSQL ? - L'œil de Skilly | FrenchTech SAAS | Scoop.it
De plus en plus, on voit une division entre les pro-MySQL et les pro-NoSQL. Si MySQL est le plus utilisé historiquement, NoSQL (Not Only SQL) se développe dans le monde[...]
No comment yet.
Scooped by Mickael Ruau
November 28, 2013 3:39 PM
Scoop.it!

Optimiser votre base de données MySQL | TheCodingMachine

Optimiser votre base de données MySQL | TheCodingMachine | FrenchTech SAAS | Scoop.it
The Coding Machine a écrit ce livre blanc pour essayer de définir la démarche à mettre en oeuvre dans le cadre de l'amélioration des performances de base de données d'une application web.
Mickael Ruau's insight:

Tout ce que vous devez savoir pour exploiter au mieux votre serveur de base de données : gestion des index, bonnes pratiques pour écrire des requêtes, paramétrage du serveur...

 

Gestion des IndexIndexation de la BDDLes index multi-colonnesCardinalité des indexRecherche de contenus text : index FULLTEXTMoteur FULL-TEXT spécialisé (LUCENE, Apache SOLR…)AgrégationAgrégation en batchAgrégation direct (triggers)Optimisation des requêtes à la base de donnéesRéduire le nombre de requêtesOptimiser les requêtes les plus critiquesEviter les requêtes imbriquéesDénormalisation du modèle de donnéesBase de données MultidimensionnellesConfiguration MySQLMyIsam vs InnoDBTaille du cache InnoDBNombre de connexions simultanéesNombre de threadsLog file
No comment yet.
Scooped by Mickael Ruau
November 23, 2013 11:54 AM
Scoop.it!

DimitriK's (dim) Weblog : November 2013

DimitriK's (dim) Weblog : November 2013 | FrenchTech SAAS | Scoop.it

Last week, during Tomas' keynote at MySQL Percona Live Conference in London we announced as one of "previews" of the following MySQL 5.7 release(s) -- anover 1,000,000 Query/sec result obtained with InnoDB Memcached plugin on a Read-Only workload. This article here is just to confirm the announced results without going too much in details..

Mickael Ruau's insight:

In fact we have no idea yet for today what are exactly the scalability and performance limits for this solution.. The huge gain in performance was possible here due initial overall speed-up made recently in MySQL 5.7 and letting us reach 500K QPS in a "normal" SQL Read-Only workload.


Then yet more improvement in the InnoDB Memcached Plugin code were possible and came just naturally. Specially since Facebook Team challenged us here pretty well by expressing all performance limitations they are hitting in their workloads. As well Facebook provided us a test case workload which we successfully used to improve even more our code. And finally the same test case was used to obtain the following benchmark results ;-)

The test was executed in "standalone" mode (both server and client are running on the same server). So, we used our biggest HW box we have in the LAB - a 48cores machine. This server was able very quickly to point us into any existing or potential performance issues and bottlenecks (and what is interesting that most of them were now on the memcached code itself). However, Query/sec rate (QPS) is depending a lot here of memory latency and CPU frequency, while this server is having 2Ghz CPU cores only, so on a faster HW you may expect even better results ;-)

No comment yet.
Scooped by Mickael Ruau
November 23, 2013 10:20 AM
Scoop.it!

MySQL Bootcamp — MySQL Bootcamp 2013 documentation

This document is for programmers new to MySQL.

Mickael Ruau's insight:

 

Contents:

MySQL setupInstallCreate Database and UserIndex (key)What’s IndexData StructureHow to find recordHow to fetch rangeSecondary IndexTips: covering indexSorting and rangesexplainHow to make an effective indexesTransactionWhat’s transactionautocommitMVCCLockMore about locksRealistic problem examplesHow to analyze problems
No comment yet.
Scooped by Mickael Ruau
November 18, 2013 8:13 AM
Scoop.it!

Dia2SQLpy

A Python script to convert Dia XML files storing a UML diagram into SQL create statements. Ideal for designing a database with Dia and creating it on MySQL or ...
No comment yet.
Scooped by Mickael Ruau
November 18, 2013 8:12 AM
Scoop.it!

DiaDBDesigner

DiaDBDesigner is a standalone module for constructing databases with the help of the diagram creation program Dia. In an easy to use environment you can join multiple diagrams together to form one model of interconnected tables.

No comment yet.
Scooped by Mickael Ruau
November 18, 2013 8:03 AM
Scoop.it!

SQL to DIA

SQL2DIA is a set of Perl scripts to generate Dia diagrams from existing databases.
No comment yet.
Scooped by Mickael Ruau
November 18, 2013 7:55 AM
Scoop.it!

dia2sql [Wiki lairdutemps.org]

La doc sur l'utilisation de dia pour générer du sql est rare…

doc officielle de tedia2sql (en), mais tedia2sql ne sait plus faire d'export sql depuis dia 0.97 (qui est la version de squeeze). Il faut utiliser parsediasql (aka Parse::Dia::SQL), dispo en v 0.16 dans squeeze (paquet libparse-dia-sql-perl).

http://left.subtree.org/2007/12/05/database-design-with-dia/ est un petit tutoriel pour débuter.

 
Mickael Ruau's insight:

Un truc qui peut être énervant, pas moyen de modifier une "boite"… il faut choisir l'outil "curseur" (qui revient ensuite à "flèche de sélection", qui permet d'afficher les propriétés au double clic mais pas d'éditer le contenu).

Choisir tedia2sql dans le menu déroulant de la palette d'outils de dia restreint aux boutons qui vont bien, mais UML marche aussi.

primary key : mettre l'attribut en "protected"index : onglet opérations, type : "index" ou "unique index", ajouter en paramètres les champs concernésauto_increment : c'est spécifique à mysql, il faut utiliser l'outil "Small Package" de "UML" (il s'appelle "Séquences" dans "tedia2sql"), et mettre "mysql: typemap" en Stereotype, avec comme valeur par ex "id_auto : int unsigned auto_increment;", qui va crée le type de colonne interne à dia "id_auto".foreign key : faut utiliser les relations, pas bien clair…jeu de données : c'est l'outil composant, mettre dans propriétés/stéréotype "ma_table(champs1, champs2)" et dans la boite les valeurs, une par ligne (comme elles seront écrites dans les parenthèses de VALUES() de la requête)vues : il faut cocher "abstraite" pour la classe, préciser la table concernée en opération de type "from" (et la notation table.champ s'il y a plusieurs tables), et mettre les where en opération (de type "where", idem pour order, avec des parenthèse autour de la condition ⇒ name : "(champ1 > 1)"; type : "where")  
No comment yet.
Scooped by Mickael Ruau
November 17, 2013 9:57 AM
Scoop.it!

deltasql

deltasql | FrenchTech SAAS | Scoop.it
Version Control for your Database
Mickael Ruau's insight:

deltasql is an advanced Database Schema Version Control. It allows a team to commonly develop a data model on the fly, while the source code is growing. Sync algo supports branches and tags. Works for mySQL, postgreSQL, Oracle or any SQL-like db.

No comment yet.
Scooped by Mickael Ruau
November 16, 2013 3:25 PM
Scoop.it!

Optimizing MySQL Database Operations for Better Performance - Automated Trader (blog)

Optimizing MySQL Database Operations for Better Performance
Automated Trader (blog)
The opinions expressed by this blogger and those providing comments are theirs alone, this does not reflect the opinion of Automated Trader or any employee thereof.
No comment yet.
Scooped by Mickael Ruau
November 16, 2013 3:23 PM
Scoop.it!

Elasticsearch fait de l'ombre à Solr

Elasticsearch fait de l'ombre à Solr | FrenchTech SAAS | Scoop.it
Dans le petit monde des moteurs de recherche, Solr était jusqu'à 2012 le moteur de recherche open source le plus complet, mais cela a quelques peu changé depuis la sortie d’Elasticsearch.
No comment yet.
Scooped by Mickael Ruau
November 16, 2013 10:16 AM
Scoop.it!

Data Cleansing & Address Correction: SQL Power DQguru | SQL Power Software

Data Cleansing & Address Correction: SQL Power DQguru | SQL Power Software | FrenchTech SAAS | Scoop.it
Data Cleansing & MDM Tool

The SQL Power DQguru helps you cleanse your data, validate and correct addresses, identify and remove duplicates, and build cross-references between source and target tables. This provides business users with complete and accurate data, and a single 360-degree view of all business entities, such as customer, product, representative, employee, supplier or business unit.

Mickael Ruau's insight:
Features

Intuitive GUI allows for quick adoption and use by data analystsIntuitive 'transform' process interface allows you to rapidly build and deploy data conversion work flowsUsers can define their own data matching criteriaDuplicate verification via SQL Power's innovative interfaceMerge duplicates and their related dataCan be used for initial or periodic data clean-upGenerates cross reference tables to link source system identifiers to target database identifiersExtensive support for transformation and matching functions:ConcatenationDouble Metaphone, Metaphone, Refined Soundex, Soundex phonetic codingAlphabet case conversionString substitutionSubstring and substring by wordWord substitution through the translation of words or groups of wordsMerge rules for column, table and related table mergesVarying levels of data transformation are also supported to help manage the development and execution of data cleansing processes:The Match Engine identifies duplicates, storing the results in a target table, without modifying the source dataThe Merge Engine removes duplicate records from your source data according to the rules you have definedThe Cleansing Engine replaces records in your source data with reformatted data as per your rulesExtensive support for many databases as for source and target data
(See System Requirements for a complete list)
No comment yet.
Scooped by Mickael Ruau
December 3, 2013 3:08 AM
Scoop.it!

Visual Guide to NoSQL Systems

Visual Guide to NoSQL Systems | FrenchTech SAAS | Scoop.it
There are so many NoSQL systems these days that it's hard to get a quick overview of the major trade-offs involved when evaluating relational and non-relational systems in non-single-server...
Mickael Ruau's insight:

Now for the particulars of each CAP configuration and the systems that use each configuration:

Consistent, Available (CA) Systemshave trouble with partitions and typically deal with it with replication. Examples of CA systems include:

Traditional RDBMSs like Postgres, MySQL, etc (relational)Vertica (column-oriented)Aster Data (relational)Greenplum (relational)

Consistent, Partition-Tolerant (CP) Systems have trouble with availability while keeping data consistent across partitioned nodes. Examples of CP systems include:

BigTable (column-oriented/tabular)Hypertable (column-oriented/tabular)HBase (column-oriented/tabular)MongoDB (document-oriented)Terrastore (document-oriented)Redis (key-value)Scalaris (key-value)MemcacheDB (key-value)Berkeley DB (key-value)

Available, Partition-Tolerant (AP) Systems achieve "eventual consistency" through replication and verification. Examples of AP systems include:

Dynamo (key-value)Voldemort (key-value)Tokyo Cabinet (key-value)KAI (key-value)Cassandra (column-oriented/tabular)CouchDB (document-oriented)SimpleDB (document-oriented)Riak (document-oriented)
No comment yet.
Scooped by Mickael Ruau
November 29, 2013 2:16 PM
Scoop.it!

How to Start Thinking Like a Data Scientist

How to Start Thinking Like a Data Scientist | FrenchTech SAAS | Scoop.it
An easy exercise to learn data analytics.
Mickael Ruau's insight:

Fortunately, you don’t have to be a data scientist or a Bayesian statistician to tease useful insights from data. 

 
No comment yet.
Scooped by Mickael Ruau
November 28, 2013 3:01 PM
Scoop.it!

NoSQL (not only SQL) - Brief Techno | TheCodingMachine

NoSQL (not only SQL) - Brief Techno | TheCodingMachine | FrenchTech SAAS | Scoop.it

Le NoSQL regroupe de nombreuses bases de données, récentes pour la plupart, qui se différencient du modèle SQL par une logique de représentation de données non relationnelle. Leurs principaux avantages sont les performances et leur capacité a traiter de très grands volumes de données.

Mickael Ruau's insight:
4 types de base de données NoSQL

1 - Clé - valeur  : La représentation la plus simple. Cette structure est très adaptée à la gestion de caches ou pour fournir un accès rapide aux informations. Elle fonctionne comme un grand tableau associatif et retourne une valeur dont elle ne connaît pas la structure.

2 - Document : Ajoute au modèle clé-valeur, l’association d’une valeur à structure non plane, c’est-à-dire qui nécessiterait un ensemble de jointures en logique relationnelle. 

3 - Colonne  : Autre évolution du modèle clé-valeur, il permet de disposer d'un très grand nombre de valeurs sur une même ligne, permettant ainsi de stocker les relations de type one-to-many. Contrairement au système Clé-Valeur, celui-ci permet d’effectuer des requêtes par clé.

4 - Graphe : Permet la modélisation, le stockage et la manipulation de données complexes liées par des relations non-triviales ou variables.

No comment yet.
Scooped by Mickael Ruau
November 23, 2013 11:09 AM
Scoop.it!

Conference analyse d'achalandage Web, Web Éducation 30 octobre 2008

Conférence offerte lors de la journée WebÉducation du 30 octobre 2008, à Québec. www.michaelcarpentier.com
No comment yet.
Scooped by Mickael Ruau
November 21, 2013 3:24 AM
Scoop.it!

MySQL encryption performance, revisited - MySQL Performance Blog

MySQL encryption performance, revisited - MySQL Performance Blog | FrenchTech SAAS | Scoop.it
Part 2 of 2 in a series on in-flight data encryption with MySQL, with an eye towards measuring and avoiding the SSL connection-time performance hit.
Mickael Ruau's insight:

Regardless of the anomaly with MySQL 5.6.13 and 4096-bit SSL, I think the primary takeaway from both this post and its predecessor is pretty clear:

 

if you need end-to-end encryption of your MySQL traffic and you’re using replication or a connection-pooling sort of workload, MySQL’s built-in SSL support will probably serve you just fine,

 

but if your application is of the type that requires setting up and tearing down large numbers of connections frequently, you might want to look at offloading that encryption work elsewhere, even if “elsewhere” just means running it through an SSH tunnel.

No comment yet.
Scooped by Mickael Ruau
November 18, 2013 8:13 AM
Scoop.it!

database diagram generator

sql2diagram converts sql scripts to diagrams in the XML format dia, which can be viewed and further maintained with the dia drawing program. 

Mickael Ruau's insight:

It is a good help for the documentation of a database structure.

It provides HTML output as well.

No comment yet.
Scooped by Mickael Ruau
November 18, 2013 8:10 AM
Scoop.it!

DIA2SQL - DIA 2 SQL statements

Dia2SQL is a Perl script to convert UML objects in DIA ( see http://www.lysator.liu.se/~alla/dia/ for more info on DIA ). Currently, it processes Dia documents ...
No comment yet.
Scooped by Mickael Ruau
November 18, 2013 8:00 AM
Scoop.it!

Yet Another dia2sql

Yet another tool to generate SQL statements from Dia XML files: CREATE TABLE, CREATE VIEW, CREATE TRIGGER, INSERT INTO, GRAND TABLE, and REVOKE. Defined ...
No comment yet.
Scooped by Mickael Ruau
November 17, 2013 10:11 AM
Scoop.it!

DBComparer

DBComparer is a tool for showing data and structural differences between databases.

Mickael Ruau's insight:

It relies on 1) the databases own internal capabilities to fetch metadata about it's objects and 2) on a file differ like WinMerge that is capable to compare folders.

No comment yet.
Scooped by Mickael Ruau
November 17, 2013 9:55 AM
Scoop.it!

Liquibase | Database Refactoring | Liquibase

Mickael Ruau's insight:
Works with your development styleSupports code branching and mergingSupports multiple developersSupports over 15 database typesSupports XML, YAML, JSON, and SQL formatsPowerful refactoring commandsSimple commands like Create Table and Drop ColumnComplex commands like Add Lookup Table andMerge ColumnsPlus the ability to Generate and manage rollback logicOpen and ExtensibleOpen Source: Apache 2.0 LicensePlugin/extensions supportJava Integration APIsWorks with your development processesCommand Line, Ant, Maven, Spring, and Servlet integrationsCluster-safe database upgradesDatabase "diff's"Database change documentationAutomated generation of SQL scripts for DBA code review and approval
No comment yet.
Scooped by Mickael Ruau
November 16, 2013 3:23 PM
Scoop.it!

Popular ORMs Don’t do SQL

Popular ORMs Don’t do SQL | FrenchTech SAAS | Scoop.it
I’m contemplating about what has happened in the ISO / IEC SQL standard during the last 15 years. We’ve had quite a few new features added to our beloved SQL language.
No comment yet.
Scooped by Mickael Ruau
November 16, 2013 3:20 PM
Scoop.it!

CODASQL

CODASQL | FrenchTech SAAS | Scoop.it
What happened in the early 70s, remember that Codd-Bachman great debate? Before Codd database field has been viewed as proprietary engineering playground. Everybody thought that databases are well understood.
No comment yet.