<?xml version='1.0' encoding='UTF-8'?><rss xmlns:atom='http://www.w3.org/2005/Atom' xmlns:openSearch='http://a9.com/-/spec/opensearchrss/1.0/' xmlns:georss='http://www.georss.org/georss' version='2.0'><channel><atom:id>tag:blogger.com,1999:blog-7670498351595405283</atom:id><lastBuildDate>Thu, 07 May 2009 21:36:31 +0000</lastBuildDate><title>Data Services Connection</title><description>&lt;b&gt;Welcome to the &lt;a href="http://www.data-conn.com"&gt;Data-Conn.com&lt;/a&gt; network.&lt;/b&gt;
&lt;b&gt;
&lt;br&gt;&lt;a href="http://www.odbc-connection.com"&gt;ODBC-Connection&lt;/a&gt;
&lt;br&gt;&lt;a href="http://www.jdbc-connection.com"&gt;JDBC-Connection&lt;/a&gt;
&lt;br&gt;&lt;a href="http://www.dotNET-connection.com"&gt;dotNET-Connection&lt;/a&gt;
&lt;br&gt;&lt;a href="http://www.xml-connection.com"&gt;XML-Connection&lt;/a&gt;
&lt;br&gt;&lt;a href="http://www.mainframe-connection.com"&gt;Mainframe-Connection&lt;/a&gt;
&lt;br&gt;&lt;a href="http://www.datadirect.com"&gt;DataDirect.com&lt;/a&gt;&lt;/b&gt;</description><link>http://www.dataservices-connection.com/</link><managingEditor>noreply@blogger.com (Eric Samson)</managingEditor><generator>Blogger</generator><openSearch:totalResults>132</openSearch:totalResults><openSearch:startIndex>1</openSearch:startIndex><openSearch:itemsPerPage>25</openSearch:itemsPerPage><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-8143054475170803982</guid><pubDate>Thu, 07 May 2009 20:50:00 +0000</pubDate><atom:updated>2009-05-07T14:13:00.030-07:00</atom:updated><title>Why Data Modeling is the Wrong Tool for Integrating Data Models</title><description>Fresh ideas &lt;a href="http://activeknowledgemodeling.com/2009/05/04/why-data-modeling-is-the-wrong-tool-for-integrating-data-models/"&gt;in this article about how to build common data models&lt;/a&gt;, even if I wouldn't agree with everything.&lt;div&gt;&lt;div&gt;&lt;br /&gt;&lt;div&gt;&lt;br /&gt;&lt;/div&gt;&lt;/div&gt;&lt;/div&gt;&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-8143054475170803982?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2009/05/why-data-modeling-is-wrong-tool-for.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-7133364179450033582</guid><pubDate>Thu, 07 May 2009 20:48:00 +0000</pubDate><atom:updated>2009-05-07T14:10:09.021-07:00</atom:updated><title>Tactical Data Integration with JBoss Federate</title><description>&lt;div&gt;Video about Federate, the new open source version of the former MetaMatrix EII product:&lt;/div&gt;&lt;div&gt;&lt;br /&gt;&lt;/div&gt;&lt;a href="http://architects.dzone.com/videos/screencast-tactical-data"&gt;http://architects.dzone.com/videos/screencast-tactical-data&lt;/a&gt;.&lt;div&gt;&lt;br /&gt;&lt;/div&gt;&lt;div&gt;&lt;a href="http://www.jboss.org/community/docs/DOC-12956/version/11;jsessionid=8BE94DA443946D6642F6033695F195B7"&gt;Federate Project&lt;/a&gt;. (most of links don't work)&lt;/div&gt;&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-7133364179450033582?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2009/05/tactical-data-integration-with-jboss.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-866278148854627856</guid><pubDate>Thu, 07 May 2009 20:44:00 +0000</pubDate><atom:updated>2009-05-07T13:47:59.592-07:00</atom:updated><title>DryadLINQ</title><description>&lt;div&gt;Quite interesting automatisation of distributed queries:&lt;/div&gt;&lt;a href="http://www.infoq.com/news/2009/05/DryadLINQ"&gt;http://www.infoq.com/news/2009/05/DryadLINQ&lt;/a&gt;&lt;div&gt;&lt;br /&gt;&lt;/div&gt;&lt;div&gt;Microsoft research project.&lt;/div&gt;&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-866278148854627856?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2009/05/dryadlinq.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-3551031431481493590</guid><pubDate>Tue, 03 Feb 2009 21:24:00 +0000</pubDate><atom:updated>2009-02-03T13:30:34.933-08:00</atom:updated><title>Data Services presentation at The Open Group Conference</title><description>I did a presentation about Data Services yesterday at the &lt;a href="http://www.opengroup.org/sandiego2009-apc/"&gt;Open Group Conference in San Diego&lt;/a&gt;. The session went very well and we had a series of good questions / feedback:&lt;br /&gt;&lt;ul&gt;&lt;li&gt;How is security managed in a DSP?&lt;/li&gt;&lt;li&gt;What about transaction management?&lt;/li&gt;&lt;li&gt;Is that a good platform for mobile applications?&lt;/li&gt;&lt;li&gt;Where are metadata deployed?&lt;/li&gt;&lt;li&gt;Can we call this a Data Hub?&lt;/li&gt;&lt;li&gt;What about deployment of a DSP within an ESB?&lt;/li&gt;&lt;li&gt;What are the real infrastructure costs of WOA and how to compute/compare them?&lt;/li&gt;&lt;li&gt;What is the link between a DSP and MDM? &lt;em&gt;(see my recent article about this subject)&lt;/em&gt;&lt;/li&gt;&lt;/ul&gt;&lt;p&gt;Seems the benefits of a Data Services Platform are now widely accepted.&lt;/p&gt;&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-3551031431481493590?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2009/02/data-services-presentation-at-open.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-2489079125573421263</guid><pubDate>Tue, 03 Feb 2009 20:48:00 +0000</pubDate><atom:updated>2009-02-03T13:05:55.665-08:00</atom:updated><title>Pseudo transactions with non-XA resources</title><description>I've seen this article about &lt;a href="http://www.theserverside.com/tt/articles/article.tss?l=JavaPseudoTransactions"&gt;Pseudo-transactions with non XA-resources&lt;/a&gt; on TheServerSide. Well, basically what they do is a manual compensation of the non-transactional resources. There are many ways to implement this, some of them could be quite operational, but this is not my point today.&lt;br /&gt;&lt;br /&gt;It is quite possible in the future that we'll have to think differently about transactions. First of all, because it will be always difficult to manage non-transactional resources. Second, the &lt;em&gt;real problems&lt;/em&gt; will raise when we'll start to deal with &lt;em&gt;asynchronous data access patterns&lt;/em&gt;, e.g. when you call a data services and you don't wait for the answer, you'll get it later (maybe).&lt;br /&gt;&lt;br /&gt;The multi-agents systems and the actor languages give interesting ideas about this. An actor language is like an object language in which &lt;em&gt;every method call is asynchronous by default&lt;/em&gt;, any required synchronisation having to be explicitely defined and managed (continuations, etc.).&lt;br /&gt;&lt;br /&gt;I've recently read interesting articles about this. Some people are saying we can just drop the whole notion of transactions. It could be shocking at the beginning but they have good arguments. Other ones think we must change the problem until we can have atomic transactions: see for instance "&lt;em&gt;Life beyond distributed transactions&lt;/em&gt;" by &lt;strong&gt;Pat Helland&lt;/strong&gt; (from Amazon) or the &lt;em&gt;Saga&lt;/em&gt; transaction system from &lt;strong&gt;Arnon Rotem&lt;/strong&gt;.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-2489079125573421263?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2009/02/pseudo-transactions-with-non-xa.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-3863038239673362203</guid><pubDate>Mon, 19 Jan 2009 19:49:00 +0000</pubDate><atom:updated>2009-01-22T13:03:24.221-08:00</atom:updated><title>The Role of a Data Services Layer in SOA</title><description>UK-trade journal, &lt;em&gt;Database &amp;amp; Network Journal&lt;/em&gt;, has published one of my articles in their January issue: “&lt;strong&gt;Bringing Data into Service: The Role of a Data Services Layer in SOA&lt;/strong&gt;”. I'm not aware of any Web version of it, I'm looking for a solution to make it available online. Stay tuned.&lt;br /&gt;&lt;br /&gt;You can read the article &lt;a href="http://www.datadirect.com/docs/database_network_journal_soa.pdf"&gt;here&lt;/a&gt;.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-3863038239673362203?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2009/01/role-of-data-services-layer-in-soa.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-8572275172513942341</guid><pubDate>Mon, 19 Jan 2009 19:41:00 +0000</pubDate><atom:updated>2009-01-19T11:49:40.056-08:00</atom:updated><title>How MDM and Data Services can be Complementary</title><description>I'm pleased to inform you that &lt;a href="http://www.dmreview.com/"&gt;DM Review&lt;/a&gt; has published &lt;a href="http://www.dmreview.com/specialreports/2008_122/10002308-1.html"&gt;my article&lt;/a&gt; about Data Services Platforms and Master Data Management.&lt;br /&gt;&lt;br /&gt;In the past, I used to think that MDM was mostly an issue for EII products. Today, most EII have turned themselves into &lt;em&gt;Data Services&lt;/em&gt;, but there are other approaches to Data Services Platforms. Based on my discussions my some MDM vendors I'm now convinced that DSP platforms have an important role to play in that space. You'll see all the details in the article.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-8572275172513942341?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2009/01/how-mdm-and-data-services-can-be.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-753961386977683611</guid><pubDate>Thu, 08 Jan 2009 16:40:00 +0000</pubDate><atom:updated>2009-01-08T12:26:00.331-08:00</atom:updated><title>SOA is dead?</title><description>First of all, I wish you &lt;strong&gt;all the best for 2009!&lt;/strong&gt;&lt;br /&gt;&lt;br /&gt;This new year starts with an obituary news, from Ann Thomas Mann (Burton Group): &lt;a href="http://apsblog.burtongroup.com/2009/01/soa-is-dead-long-live-services.html"&gt;SOA is dead&lt;/a&gt;. This blog entry has generated a lot of reactions, and that was probably one of its aims:&lt;br /&gt;&lt;ul&gt;&lt;li&gt;&lt;a href="http://www.infoq.com/news/2009/01/is-soa-dead"&gt;InfoQ - Debate Is SOA Dead&lt;/a&gt; &lt;/li&gt;&lt;li&gt;&lt;a href="http://blogs.zdnet.com/service-oriented/?m=200901"&gt;ZDNet - SOA dead as of January 1st 2009&lt;/a&gt; &lt;/li&gt;&lt;li&gt;&lt;a href="http://tech.yahoo.com/news/infoworld/20090106/tc_infoworld/121447"&gt;Yahoo Tech - SOA Gets an obituary&lt;/a&gt; &lt;/li&gt;&lt;li&gt;&lt;a href="http://www.eweek.com/c/a/Web-Services-Web-20-and-SOA/SOA-Wanted-Dead-or-Alive/"&gt;eWeek - SOA wanted dead or alive&lt;/a&gt; &lt;/li&gt;&lt;li&gt;&lt;a href="http://www.ebizq.net/blogs/linthicum/2009/01/so_if_soa_is_dead_should_we_fo.php"&gt;eBizq - So, if SOA is dead, should we focus more on the data?&lt;/a&gt; &lt;/li&gt;&lt;/ul&gt;&lt;p&gt;(just to mention a few of them).&lt;/p&gt;&lt;p&gt;In fact, what she says is that &lt;em&gt;service-orientation&lt;/em&gt; is still needed but the SOA TLA is now too heavily associated with the idea of project failure.&lt;/p&gt;&lt;p&gt;First comments:&lt;/p&gt;&lt;ul&gt;&lt;li&gt;Seems to me all this is more provocation than anything else, done to generate some noise and visibility. Regarding this, it is a success.&lt;/li&gt;&lt;li&gt;She is just writing what many were thinking and even saying since many years.&lt;/li&gt;&lt;li&gt;People tend to quickly burn the idols they have created themselves. So that they can quickly idolize another one... with the same unreasonable passion.&lt;/li&gt;&lt;li&gt;Sometimes it needs time, even for a good idea, to impose itself. Unfortunately, the World and the software industry are now stuck in short-term visions and immediate ROI, there is no more time for ideas to mature. New concepts now have to be perfect from inception, there is no room for improvement.&lt;/li&gt;&lt;li&gt;If we agree that SOA is not a technology but rather a way of thinking software architectures, then saying that "&lt;em&gt;SOA is dead but there is still a need for the idea of services&lt;/em&gt;" is a kind of oxymore.&lt;/li&gt;&lt;li&gt;If SOA is really wrong, changing it's name won't fix it. WOA, RESTFul, Mashups won't save services if the main idea behind it is not good. The problem cannot just be with the &lt;em&gt;SOA&lt;/em&gt; name.&lt;/li&gt;&lt;/ul&gt;&lt;p&gt;So, what was really wrong with this supposedly dying SOA?&lt;/p&gt;&lt;ol&gt;&lt;li&gt;&lt;strong&gt;SOA is much more complicated than expected&lt;/strong&gt;. Remember: the 'S' in SOAP means "simple". SOA was supposed to be simpler than CORBA and J2E. But why SOA would have been less complicated than its predecessors? When you want to design non-trivial business applications by assembling distributed components you will face complexity. Using HTTP / SOAP instead of IIOP and WSDL instead of IDL will not fundamentally change the thing. The problem is still complex and unfortunately (or not) we don't have easy solutions to complex problems yet. Thinking large systems as communicating distributed agents is not so easy. It is all about parallel asynchronous programming. Most developers are not trained for that, as they were not trained to be Java gurus. It is so funny to see that today SOA is attacked on the simplicity front.&lt;/li&gt;&lt;li&gt;&lt;strong&gt;SOA is too much process-centric&lt;/strong&gt;. And once again, it was the same with CORBA and J2E. All distributed arhcitectures are first trying to solve the easy problem first: distribute processes. Then they start to deal with data and the real problems raise.&lt;/li&gt;&lt;/ol&gt;&lt;p&gt;But it is not necessarily too late for SOA, as far as we can reconcile data and processes, states and behaviors, attributes and methods, however you name it.&lt;/p&gt;&lt;p&gt;&lt;em&gt;So let's go back to the fundamentals. David Linthicum is thinking in &lt;a href="http://www.ebizq.net/blogs/linthicum/2009/01/so_if_soa_is_dead_should_we_fo.php"&gt;the right direction&lt;/a&gt;: How to deal with data in SOA?&lt;/em&gt; &lt;/p&gt;&lt;p&gt;That's where we are today in SOA. &lt;strong&gt;Data Services&lt;/strong&gt; are clearly going in the right direction. Customers will be able to solve some of their data integration issues with SOA, and they will have time to understand the value of this approach. To some extent, Data Services are at the cross between the promises of SOA and OO: states encapsulated by business methods. &lt;/p&gt;&lt;p&gt;Obviously, we'll need to go further, move from simple data federation to &lt;strong&gt;adaptative mediation&lt;/strong&gt;, but we'll have time as we are solving real problems in the meantime. &lt;/p&gt;&lt;p&gt;Data Services should not be too much focused on names like SOA, WOA, RESTFul, mashups. New architectures are not replacing old ones (even if their proponents always tend to think it, at the beginning). They just complement them. Data Services platforms should equally support all these styles. Data Services Platforms should publish integrated data as SOA-or-not services, but also as POJOs, xDBC... The same way they have to connect to SOA-or-not data services as data sources, but also to RDBMS, packaged applications, mainframe transactions and screens, etc. The real IT world will certainly never be &lt;em&gt;all-SOA&lt;/em&gt;, but equally it won't be &lt;em&gt;all-non-SOA&lt;/em&gt;.&lt;/p&gt;&lt;p&gt;&lt;em&gt;Services&lt;/em&gt; are basically &lt;em&gt;components&lt;/em&gt;. There are many deep reasons why imposing a component-oriented design has continuously failed for decades. SOA is a new try and it won't be the last one. Component-based progamming models have failed for cultural reasons (programmers are not ready for that) and also because of the &lt;em&gt;Lego model&lt;/em&gt;. You can't build a complex system by manually linking thousands of atomic components. &lt;strong&gt;SOA is way too much manually hard-coded today&lt;/strong&gt;. We need to be able to dynamically generate, publish and compose services at runtime. We need to design new data access patterns, maybe based on asynchronous, reactive models. This will require advanced metadata, more &lt;strong&gt;semantic metadata&lt;/strong&gt; and dynamic computation of chains of service calls at runtime. All this won't be achieved in few years. &lt;/p&gt;&lt;p&gt;In the meantime, programmers will progressively have to accept they won't control the flow of service calls, exactly as DBAs had to accept they won't tune all SQL statements any longer with the raise of persistence technologies. Each time you add abstraction layers you are able to do more, but conversely you lose some visibility and control on the lower layers.&lt;/p&gt;&lt;p&gt;So, the real debate is not &lt;em&gt;what's next after SOA?&lt;/em&gt;, or &lt;em&gt;which style of service-orientation will win?&lt;/em&gt; REST is not simpler than SOA if you want to manage complex things by manually connecting services. If one day we want to solve complex problems with simple solutions, then we'll need new abstraction layers, we need dynamic SOA. And for that, we need to stop manually calling and connecting services. Regarding this &lt;em&gt;SOA versus WOA&lt;/em&gt; or &lt;em&gt;SOAP versus REST&lt;/em&gt; is not the point at all. Services are a required piece in the puzzle, but we need new abstractions on top of them.&lt;/p&gt;&lt;p&gt;See the funny &lt;em&gt;REST is dead&lt;/em&gt; blog entry &lt;a href="http://service-architecture.blogspot.com/2009/01/rest-is-dead-long-live-web.html"&gt;here&lt;/a&gt;.&lt;/p&gt;&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-753961386977683611?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2009/01/soa-is-dead.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-1006849756892810011</guid><pubDate>Mon, 15 Dec 2008 17:45:00 +0000</pubDate><atom:updated>2008-12-15T09:58:40.796-08:00</atom:updated><title>EMC Atmos</title><description>Let's try to be more positive about &lt;em&gt;new data sources for the cloud&lt;/em&gt;, after the harsh comment of a reader seen in my previous post. Last week, I had the opportunity to discover &lt;a href="http://www.emc.com/products/detail/software/atmos.htm"&gt;Atmos&lt;/a&gt;, a new Cloud Optimized Storage (COS) from EMC.&lt;br /&gt;&lt;br /&gt;What I particularly liked is the fact it is based on an object-oriented distributed file system. Microsoft wanted to build such a file system few years ago and eventually they gave up. EMC did it. I still need to dig into the details of that product, but I really think the possibilities of a true OOFS are almost impossible to imagine right now.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-1006849756892810011?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/12/emc-atmos.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-1374677455347867710</guid><pubDate>Mon, 15 Dec 2008 17:17:00 +0000</pubDate><atom:updated>2008-12-15T09:36:06.992-08:00</atom:updated><title>Performance of new databases</title><description>Interesting &lt;a href="http://oakleafblog.blogspot.com/2008/12/test-harnesses-compare-amazon-ec2-with.html"&gt;performance comparison&lt;/a&gt; from Oakleaf. They compare an Amazon EC2 application deployed with different storage options (SQL Server, SimpleDB and Azure Table Service).&lt;br /&gt;&lt;br /&gt;I reproduce the result table, if you have no time to read the article:&lt;br /&gt;&lt;a href="http://www.dataservices-connection.com/uploaded_images/okaleaf-cloud-db-comparison-703012.jpg"&gt;&lt;/a&gt;&lt;a href="http://www.dataservices-connection.com/uploaded_images/okaleaf-cloud-db-comparison-754331.jpg"&gt;&lt;img style="MARGIN: 0px 10px 10px 0px; WIDTH: 400px; FLOAT: left; HEIGHT: 60px; CURSOR: hand" border="0" alt="" src="http://www.dataservices-connection.com/uploaded_images/okaleaf-cloud-db-comparison-754269.jpg" /&gt;&lt;/a&gt;&lt;br /&gt;&lt;p&gt;&lt;/p&gt;&lt;p&gt;&lt;/p&gt;&lt;p&gt;&lt;/p&gt;&lt;p&gt;&lt;/p&gt;&lt;p&gt;&lt;/p&gt;&lt;p&gt;&lt;/p&gt;&lt;p&gt; &lt;/p&gt;&lt;p&gt;    &lt;/p&gt;&lt;p&gt;A reader's comment:&lt;/p&gt;&lt;em&gt;&lt;blockquote&gt;&lt;p&gt;&lt;em&gt;A major piece of work by OakLeaf … has confirmed my suspicions about how inappropriate all the cloud name/value entity store technologies are for serious SaaS developers.&lt;br /&gt;The Google AppEngine Datastore, Amazon’s SimpleDB and Windows Azure have chronic performance problems relative to conventional database throughput. Ultimately, the inherent inefficiencies of these storage options will hit hourly cloud renters in the pocket.&lt;/em&gt;&lt;/p&gt;&lt;/blockquote&gt;&lt;/em&gt;&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-1374677455347867710?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/12/performance-of-new-databases.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-2478554320224668242</guid><pubDate>Mon, 15 Dec 2008 16:52:00 +0000</pubDate><atom:updated>2008-12-15T09:04:20.568-08:00</atom:updated><title>Semantic SOA</title><description>Seen this &lt;a href="http://www.infoq.com/news/2008/12/ReferenceOntology"&gt;post&lt;/a&gt; on InfoQ, OASIS has released a new version of their &lt;a href="http://docs.oasis-open.org/soa-rm/soa-ra/v1.0/soa-ra-pr-01.pdf"&gt;Reference Model for SOA&lt;/a&gt;.&lt;br /&gt;&lt;br /&gt;It is well admitted that if we want to have SOA more policy-driven we must stop to manually compose services together. And this can mostly be achieved through extended metadata (I mean more than WSDL). WSDL was a nice beginning but:&lt;br /&gt;&lt;ul&gt;&lt;li&gt;Is is limited to Web services, and not all services are Web services. For instance some existing mainframes applications, transactions, green screens, APIs of packaged applications and Stateless Session EJBs are also services.&lt;/li&gt;&lt;li&gt;Relationships between entities are missing.&lt;/li&gt;&lt;li&gt;There is nothing about behavior of services.&lt;/li&gt;&lt;/ul&gt;&lt;p&gt;The whole &lt;em&gt;Semantic Web&lt;/em&gt; is an ambitious set of projects. However, when it comes to data access in SOA, we have to deal with the same kind of issues. Accessing a data services layer is more complicated than accessing a databaase, because it publishes a business interface instead of a technical interface. Therefore, if we want to dynamically compose data services together, as opposed to hard-code the combinations, we need some kind of &lt;em&gt;semantic metadata&lt;/em&gt; about the data manipulation behavior. &lt;/p&gt;&lt;p&gt;That &lt;strong&gt;dynamic aspect&lt;/strong&gt; is fundamental for modern Data Services Platforms and is quite often missing in first generation technologies.&lt;/p&gt;&lt;p&gt;The first step of SOA was all about designing, deploying and consuming services. The second step is now all about dynamically designing, dynamically deploying and dynamically consuming services. We cannot spend all our time in manually connecting thousands of services together.&lt;/p&gt;&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-2478554320224668242?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/12/semantic-soa.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-4692695703145188612</guid><pubDate>Mon, 15 Dec 2008 16:07:00 +0000</pubDate><atom:updated>2008-12-15T08:46:17.279-08:00</atom:updated><title>The Information Perspective of SOA Design</title><description>Seen this &lt;a href="http://www.infoq.com/news/2008/12/SOAInformation"&gt;post&lt;/a&gt; on InfoQ. I like to see that most people agree on the need to reintroduce the data aspect into SOA. You should read the full &lt;a href="http://www.ibm.com/developerworks/data/library/techarticle/dm-0801sauter/index.html?ca=drs-"&gt;article&lt;/a&gt; from IBM, but they basically insist on 3 points:&lt;br /&gt;&lt;ul&gt;&lt;li&gt;Define data semantics.&lt;/li&gt;&lt;li&gt;Canonical modeling.&lt;/li&gt;&lt;li&gt;Data quality.&lt;/li&gt;&lt;/ul&gt;&lt;p&gt;The 2 first points are at the heart of any &lt;strong&gt;Data Services Platform&lt;/strong&gt;. &lt;/p&gt;&lt;p&gt;&lt;em&gt;Defining Data Semantics&lt;/em&gt; is very important and should be done with extended metadata. The richer the metadata are, the further we can decouple data sources form data consumers. And this is a strong requirement if you want to be more "policy-driven" and less hard-coded in your data access strategies.&lt;/p&gt;&lt;p&gt;&lt;em&gt;Canonical modeling&lt;/em&gt; is sometimes seen as a burden by database purists. However, it is required as soon as you need to federate heterogeneous data sources, that is the common case in SOA. On top of that, canonical models offer a more business-friendly view of data. The question remain about the scope of canonical modeling. Very large business models, at the enterprise level, are known to be very difficult to design and to maintain. DSP must offer a way to select the best granularity for canonical models. One model for all applications is a myth (at least today), but conversely, one model per application does not allow reaching the promises of reuse of SOA. On this aspect it is also interesting to track what vertical standardization efforts (SID, HL7, Acord, SWIFT, etc.) could bring on the table. We now see users starting to use the Telco SID model outside of the Telco market, for instance (from a 40,000 ft perspective, a customer is a customer).&lt;/p&gt;&lt;p&gt;The third one, is a market by itself (MDM) but should also be accessible from within a Data Services Platform. Relationhips between MDM and DSP technologies are multiple. DSP can be used as a synchronization layer for MDM products. DSP can support reference data, as a new kind of data sources, capturing their specific meaning (reference data can be a link to the real data, of maintain a link with it). DSP could use data cleaning services to improve data quality. These are just examples.&lt;/p&gt;&lt;p&gt;All in all, this is all going in the right direction.&lt;/p&gt;&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-4692695703145188612?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/12/information-perspective-of-soa-design.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-2832497047856282495</guid><pubDate>Mon, 08 Dec 2008 14:06:00 +0000</pubDate><atom:updated>2008-12-08T06:18:20.050-08:00</atom:updated><title>Criticism of Java persistence</title><description>The recent &lt;a href="http://www.theserverside.com/news/thread.tss?thread_id=52106"&gt;Criticsm of Java Persistence thread&lt;/a&gt; on TheServerSide shows us once again that data access is still a very sensitive, emotional and almost religious topic.&lt;br /&gt;I have said what I had to say in the thread itself, so no need to duplicate this here.&lt;br /&gt;&lt;br /&gt;Many people have wrong ideas about persistence in general, and many people have their own views about how to manage it (while conversely very few people are publicly defending their opinion about how to manage pages in an operating system for instance). There is definitely something special about data access and persistence.&lt;br /&gt;&lt;br /&gt;&lt;strong&gt;NB&lt;/strong&gt;: I really think ODBMS vendors should stop communicating on the "&lt;em&gt;the best mapping is no mapping&lt;/em&gt;" moto. First it is not true, and second it does not help them.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-2832497047856282495?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/12/criticism-of-java-persistence.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-7908000438659410920</guid><pubDate>Fri, 05 Dec 2008 16:21:00 +0000</pubDate><atom:updated>2008-12-05T08:23:14.494-08:00</atom:updated><title>ODMG's not dead?</title><description>Seems OMG will host an &lt;em&gt;&lt;a href="http://www.odbms.org/blog/2008/12/omg-is-hosting-object-database-standard.html"&gt;Object Database Standard Definition Scope&lt;/a&gt;&lt;/em&gt; meeting in Santa Clara, next week.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-7908000438659410920?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/12/odmgs-not-dead.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-4109323812931766979</guid><pubDate>Fri, 05 Dec 2008 15:43:00 +0000</pubDate><atom:updated>2008-12-10T06:16:34.700-08:00</atom:updated><title>Versant acquired db4o yesterday</title><description>See the news from the &lt;a href="http://www.versant.com/en_US/news_events/pressreleases/pressreleases_2008/earnings_release_FY2008.html/0"&gt;Versant site&lt;/a&gt; and from the &lt;a href="http://developer.db4o.com/blogs/community/archive/2008/12/05/db4o-gains-support-of-versant-corporation-the-leading-commercial-odbms-company.aspx"&gt;db4o blog&lt;/a&gt;.&lt;br /&gt;&lt;br /&gt;Well, that the Enterprise ODBMS buying the embedded ODBMS. Don't know what it means to the ODBMS community. Does it means that eventually the db4o business model didn't work as expected despite the good image of the product and company on the market? I also don't clearly see what it means to the Poet's FastObject part of Versant...&lt;br /&gt;&lt;br /&gt;I know both products quite well, and I know both teams share some common genuine values around quality and performance. Even if I now work for a company who owns ObjectStore, I wanted to send a sincere "good luck" to them.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-4109323812931766979?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/12/versant-acquired-db4o-yesterday.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>1</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-9110663093541678348</guid><pubDate>Tue, 02 Dec 2008 16:35:00 +0000</pubDate><atom:updated>2008-12-02T08:45:32.147-08:00</atom:updated><title>LINK like initiatives for Java</title><description>&lt;ul&gt;&lt;li&gt;&lt;a href="http://www.theserverside.com/news/thread.tss?thread_id=52054"&gt;LiquidForm&lt;/a&gt;: &lt;a href="http://code.google.com/p/liquidform/"&gt;http://code.google.com/p/liquidform/&lt;/a&gt;&lt;/li&gt;&lt;li&gt;&lt;a href="http://www.h2database.com/html/jaqu.html"&gt;JaQu&lt;/a&gt; from the H2 database.&lt;/li&gt;&lt;li&gt;db4o is working on some kind of LINQ equivalent I think.&lt;/li&gt;&lt;li&gt;&lt;a href="http://www.jequel.de/"&gt;JEQUEL&lt;/a&gt;.&lt;/li&gt;&lt;li&gt;&lt;a href="http://quaere.codehaus.org/"&gt;Quaere&lt;/a&gt;.&lt;/li&gt;&lt;li&gt;&lt;a href="http://groups.google.de/group/jlinq"&gt;LINQ for Java&lt;/a&gt; (Google Group).&lt;/li&gt;&lt;li&gt;&lt;a href="http://source.mysema.com/projects/querydsl-root/"&gt;Query DSL&lt;/a&gt;.&lt;/li&gt;&lt;/ul&gt;&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-9110663093541678348?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/12/link-like-initiatives-for-java.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>2</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-6606881735934524885</guid><pubDate>Wed, 26 Nov 2008 19:37:00 +0000</pubDate><atom:updated>2008-11-26T11:47:29.529-08:00</atom:updated><title>OJM</title><description>Object to JDBC Mapping: OJM.&lt;br /&gt;Seems to me when &lt;a href="http://www.theserverside.com/news/thread.tss?thread_id=52000"&gt;I first saw that new TLA&lt;/a&gt; that it was a pure oxymore.&lt;br /&gt;&lt;br /&gt;Reading the &lt;a href="http://cpo.sourceforge.net/about.html"&gt;CPO web site&lt;/a&gt; just confirmed this. There are so many strange amd sometimes inaccurate statements on this page. The author seems to ignore what modern persistence is.&lt;br /&gt;I really hate to be harsh like that, but is there really a need in 2008, for yet another JDBC abstraction?&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-6606881735934524885?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/11/ojm.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-810149904505334949</guid><pubDate>Wed, 26 Nov 2008 18:43:00 +0000</pubDate><atom:updated>2008-11-26T11:36:39.860-08:00</atom:updated><title>Different problems, different databases</title><description>The big promise of relational databases was to have a unique, single technology for all our data storage needs. The main idea was to separate data from applications manipulating data.&lt;br /&gt;Having data models too much coupled with applications model has indeed been recognized in the 70s as one of the main problems preventing IT flexibility (for instance, because producing new reports for business users required to go back to a full development cycle).&lt;br /&gt;&lt;br /&gt;But at the same time, the design of software made significant progress by recommending encapsulating data (state) within methods (behavior), clearly going in an opposite direction. This all created a lot of stress and noises in the software industry, and eventually the emergence of persistence technologies.&lt;br /&gt;&lt;br /&gt;But what really means decoupling data from applications? It mostly consists in removing explicit directional relationships from database schemas, so that data views can later be recombined in any way. When you think about it, it just means that relationships where poorly represented in programming languages, and it is still true with most modern languages including Java and C#. But to be honest, relationships are also poorly represented in relational models and this is not the nasty foreign keys that will change anything to it.&lt;br /&gt;&lt;br /&gt;The fact is that the next real big revolution in the IT world would be a first comprehensive support for the notion of relationships.&lt;br /&gt;&lt;br /&gt;Object database vendors failed to impose ODBMS while it was the most relevant choice for Java, at least from the technical point of view. There are many reasons to that:&lt;br /&gt;&lt;ul&gt;&lt;li&gt;Some first ODBMS implentations were very bad in terms of database administration, ad-hoc queries and overall performance. They were not really database but rather a storage mechanism for in-memory object pages.&lt;/li&gt;&lt;li&gt;The "ecology" never really started arounbd ODBMS (reporting tool...).&lt;/li&gt;&lt;li&gt;ODBMS started in the late 80s, exactly when RDBMS were just about to gain mometum on the market, it was not the right time to impose a new database technology.&lt;/li&gt;&lt;li&gt;Then major ODBMS vendors raised money from IPOs in the 95, in a very quiet time with no opportunity for expansion and no real need for money, therefore most of that money has been waste for nothing.&lt;/li&gt;&lt;li&gt;In 1998, the ODBMS vendors missed the Internet wave, mostly because of the XML mania at that time.&lt;/li&gt;&lt;li&gt;Then they surrendered and tried to reposition themselves as cache (Versant, Gemstone) or XML storage (Objectstore).&lt;/li&gt;&lt;/ul&gt;&lt;p&gt;Hopefully, the XML database market never really emerged, despite the huge XML hype, probably because everybody understands XML is a good exchange format but a very bad (too verbose) storage format. The big problem with XML is still that it tends to impose hierarchical models, which to some extents are a kind of regression in our industry.&lt;/p&gt;&lt;p&gt;You can easily have an object or XML layer on top of any kind of storage, including relational (see IBM pureXML, for instance). Probably the best approach would be to have neutral and efficient storages, with multiple interfaces around them. It could be a kind of relational storage with the notion of relationship efficiently supported.&lt;/p&gt;&lt;p&gt;Internet, SOA, WOA, Web 2.0, mashups, etc. all favor a style where business functionalities become independent, and thus will have their own storage (as they cannot share a common database any longer, as they are really physically distributed).&lt;/p&gt;&lt;p&gt;It now seems some vendors are now trying to push the idea that even this low-level underlying storage layer, should have different foundations, depending on the kind of problems addressed. That's why the vertical model (storage primarily organized by columns instead of rows, like in Vertica) or the key-value model are quickly growing these days.&lt;/p&gt;&lt;p&gt;They will certainly not replace RDBMS systems any soon, as some are already claiming, but they will maybe impose themselves in some situations. Seems to me the time of the omniscient relational model is about to decline, even if it will remain present for decades.&lt;/p&gt;&lt;p&gt;Data services direclty impacts the database world because:&lt;/p&gt;&lt;ul&gt;&lt;li&gt;We have more and more data sources to access from a even a simple business application.&lt;/li&gt;&lt;li&gt;The notion of transaction is change.&lt;/li&gt;&lt;li&gt;We more and more frequently have to support asynchronous data access.&lt;/li&gt;&lt;li&gt;It becomes not only possible but also mandatory to access any kind of data sources, not only relational ones.&lt;/li&gt;&lt;li&gt;Databases are progressively commoditized, and their advanced features will move to intermediate mediation layers.&lt;/li&gt;&lt;li&gt;Then it is possible to choose the best database technology for a given need, at any time.&lt;/li&gt;&lt;/ul&gt;&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-810149904505334949?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/11/different-problems-different-databases.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-5096938184627637313</guid><pubDate>Wed, 26 Nov 2008 18:19:00 +0000</pubDate><atom:updated>2008-11-26T10:42:47.844-08:00</atom:updated><title>New databases</title><description>Following my previous blog about the future of databases, I've seen these recent posts on TheServerSide:&lt;br /&gt;&lt;ul&gt;&lt;li&gt;&lt;a href="http://www.infoq.com/news/2008/11/CouchDB-Damien-Katz"&gt;Interview on CouchDB&lt;/a&gt;, the Apache project for a document database, written in Erlang, with an HTTP/REST/JSON API, already mentioned in this blog. Interesting point of view at the end about BigTable. For sure a big scalable, persistent Map is certainly interesting in some very specific cases, but it is not really a database at the end.&lt;/li&gt;&lt;li&gt;&lt;a href="http://www.theserverside.com/tt/articles/article.tss?l=WikipediaWithScalaris"&gt;Scalaris&lt;/a&gt;, a scalable, transactional data store for Web 2.0 services. Yet another distributed, persistent key-value system. That one shares many design ideas with BigTable, while, like CouchDB, it is written in Erlang. The big addition seems to be a better support for transactions. See &lt;a href="http://www.onscale.de/scalaris.html"&gt;OnScale&lt;/a&gt; for more information (videos, slides...)&lt;/li&gt;&lt;/ul&gt;&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-5096938184627637313?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/11/new-databases.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-2171886342082718585</guid><pubDate>Tue, 25 Nov 2008 15:29:00 +0000</pubDate><atom:updated>2008-11-25T08:18:27.420-08:00</atom:updated><title>The Future of Databases</title><description>Last week in San Jose, during the &lt;strong&gt;Data Services World&lt;/strong&gt; event, I've been participating to several discussions (private journalists briefings, public panels) about &lt;em&gt;the Future of Databases in the Cloud Computing&lt;/em&gt;. There are people who really seriously think today that RDBMS will soon disappear because of the Cloud.&lt;br /&gt;&lt;br /&gt;I have seen that the &lt;a href="http://www.infoq.com/news/2008/11/Database-Martin-Fowler"&gt;same topic&lt;/a&gt; has also been discussed at various locations at the same time, including interesting &lt;a href="http://martinfowler.com/bliki/DatabaseThaw.html"&gt;point of view from Martin Fowler&lt;/a&gt;.&lt;br /&gt;&lt;br /&gt;New technologies for databases can be roughly divided into two groups:&lt;br /&gt;&lt;ul&gt;&lt;li&gt;New kind of database technologies, tuned by design &lt;span style="color:#000000;"&gt;for the Cloud like Vertica, CouchDB, SimpleDB and other products alike that I've already mentioned in that blog.&lt;/span&gt;&lt;/li&gt;&lt;li&gt;&lt;span style="color:#000000;"&gt;New deployment and access for RDBMS, known as Database-as-a-Service. Basically, the database is remotely hosted and administrate, but you still access it through SQL over HTTP or SOAP/REST.&lt;/span&gt;&lt;/li&gt;&lt;/ul&gt;&lt;p&gt;&lt;span style="color:#000000;"&gt;Having worked in the past for an ODBMS vendor I know how difficult it is to convince CIOs, project managers, architects, developers and DBAs to move from RDBMS. There is a kind of religion about relational theory. My take is that RDBMS are here to stay, as mainframes did (they never disappeared as i&lt;/span&gt;t has been predicted by many "&lt;em&gt;experts&lt;/em&gt;" in the past). New technologies never replace good old ones, they just complement them.&lt;/p&gt;&lt;p&gt;Anyway, there are tangible impacts of SOA and the Cloud on the database market:&lt;/p&gt;&lt;ul&gt;&lt;li&gt;We will access more kind of data sources in the future, not only RDBMS and services, but also new kind of databases. &lt;strong&gt;Heterogeneity&lt;/strong&gt; will continue to grow.&lt;/li&gt;&lt;li&gt;We will access more data sources in the future, most applications were using single databases, they will now access multiple data sources. We are switching &lt;strong&gt;from data access to data integration&lt;/strong&gt; (I tend to prefer the term &lt;em&gt;adaptive mediation of information&lt;/em&gt;). Integration has to be done at a business level, not at the SQL one or XML one.&lt;/li&gt;&lt;li&gt;Many advanced features of databases engines (security, fault tolerance, stored procedures...) will progressively move to an intermediate integration layer. Databases, including relational databases, will go back to simple and efficient &lt;strong&gt;storage&lt;/strong&gt; technology.&lt;/li&gt;&lt;li&gt;Data integration will become more important than the database itself, databases will be commoditized. Each application development team will be able to select the best database technology for its needs.&lt;/li&gt;&lt;li&gt;Accessing non-database data sources will impose to have &lt;strong&gt;extended metadata&lt;/strong&gt;. The relational world is simple because SQL provides a convenient, technical APIs to access data at the atomic level (a cell at the cross between a row and a column). Everything is implicit, in terms of metadata, access patterns, etc. Conversely, accessing a service-oriented data source imposes to explicitly describe its data model and its &lt;strong&gt;data manipulation semantic&lt;/strong&gt;. Services can be either fined-grained or coarse-grained, you need to capture that. Data access has its contribution to the Semantic Web.&lt;/li&gt;&lt;li&gt;When thousands of data sources will be available as data services (like mainframe screens, APIs of packaged applications), we will need tools to automatically combine them at runtime. Manual, hard-coded or even visual composition of data services is a choice only when dealing with a few data services. &lt;strong&gt;Dynamic composition of data services&lt;/strong&gt; (e.g. aggregation of fine-grained data services into other larger coarse-grained data services as required by ever changing business functionalities) is imposed by the really agile IT. Otherwise "&lt;em&gt;agile&lt;/em&gt;" will turn into "fr&lt;em&gt;agile&lt;/em&gt;"!&lt;/li&gt;&lt;li&gt;&lt;strong&gt;Ad-hoc data mashups &lt;/strong&gt;will require availability of the right data services at the right time. This can only be achieved by platforms being able to &lt;strong&gt;dynamically create and publish new data services&lt;/strong&gt; as they become required. &lt;/li&gt;&lt;li&gt;Access to &lt;strong&gt;non-structured data&lt;/strong&gt; will grow. At the same time, non-structured data is on the way to structure itself or at least to describe itself better, see the "&lt;em&gt;&lt;a href="http://en.wikipedia.org/wiki/Linked_Data"&gt;Linked Data&lt;/a&gt;&lt;/em&gt;", "&lt;em&gt;&lt;a href="http://www.opencalais.com/"&gt;OpenCalais&lt;/a&gt;&lt;/em&gt;" and the "&lt;em&gt;&lt;a href="http://www.webofdata.info/"&gt;Web of Data&lt;/a&gt;&lt;/em&gt;" efforts for instance.&lt;/li&gt;&lt;li&gt;Accessing multiple data sources with different latencies will impose to deal with reactive data integration patterns. We will have to support &lt;strong&gt;asynchronous data access&lt;/strong&gt;, and we will need tools for that, because asynchronous and parallel programming are not natural to most developers and architects.&lt;/li&gt;&lt;/ul&gt;&lt;p&gt;As Martin Fowler concludes, Data services platforms are enabling the promises of SOA, by really &lt;a href="http://martinfowler.com/bliki/ApplicationDatabase.html"&gt;favoring small business functionalities having their own storage&lt;/a&gt;, instead of &lt;a href="http://www.eaipatterns.com/SharedDataBaseIntegration.html"&gt;sharing data&lt;/a&gt; in huge centralized databases.&lt;/p&gt;&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-2171886342082718585?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/11/future-of-databases.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-8098394413275131180</guid><pubDate>Mon, 10 Nov 2008 22:08:00 +0000</pubDate><atom:updated>2008-11-10T14:23:29.028-08:00</atom:updated><title>Business Objects Data Services</title><description>I've recently read several white papers about the new &lt;a href="http://www.businessobjects.com/product/im/data_services.asp"&gt;Data Services offer from Business Objects&lt;/a&gt;.&lt;br /&gt;&lt;br /&gt;Seems to me, it is basically a renaming of their former ETL and Data Quality products.&lt;br /&gt;&lt;br /&gt;It is not fundamentally surprizing to see ETL vendors moving to Data Services, as EII vendors did before them.&lt;br /&gt;Let’s say that globally an ETL is a tool to move data from DB1 to DB2, or more exactly extract data from DB1, transform data somewhere (huge debate here) and then load data into DB2.&lt;br /&gt;Now, let’s suppose you replace the third step by “publishing data”, you then have an "ETP" or even a Data Services Platform, if you publish resulting views as Web Services.&lt;br /&gt;&lt;br /&gt;Well that's probably still targetting read-only, non real-time data integration, but at least it demonstrates that Data Services are gaining momemtum on the market.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-8098394413275131180?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/11/business-objects-data-services.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-5527214973845197939</guid><pubDate>Sat, 08 Nov 2008 15:55:00 +0000</pubDate><atom:updated>2008-11-08T07:57:09.911-08:00</atom:updated><title>SOA social</title><description>I found the article mentioned in the previous post on this portal -&gt; &lt;a href="http://www.soasocial.com/"&gt;SOA Social&lt;/a&gt;.&lt;br /&gt;You'll find interesting resources over there.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-5527214973845197939?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/11/soa-social.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-8375304026335273256</guid><pubDate>Sat, 08 Nov 2008 15:53:00 +0000</pubDate><atom:updated>2008-11-08T08:07:57.819-08:00</atom:updated><title>The case for coordinated EDM and SOA</title><description>Article by Keith Worfolk in &lt;strong&gt;SOA World&lt;/strong&gt; about the benefits of coordinated strategies for &lt;a href="http://soa.sys-con.com/node/740026"&gt;Enterprise Data Management and SOA&lt;/a&gt;.&lt;br /&gt;&lt;br /&gt;Needless to say that a &lt;strong&gt;Data Services Platform&lt;/strong&gt; should be the beating heart of these coordinated strategies.&lt;br /&gt;&lt;br /&gt;I cannot agree more with the first best practice described by the author:&lt;br /&gt;&lt;em&gt;&lt;span style="font-size:85%;"&gt;"...When thinking about services, don't forget to consider the data.&lt;/span&gt;&lt;/em&gt;&lt;br /&gt;&lt;em&gt;&lt;span style="font-size:85%;"&gt;Systematically designing a service model is like designing a data model. For either, its impact should be considered long term, and the level of normalization of designed components, services, or data is considered a sign of quality and maturity.&lt;/span&gt;&lt;/em&gt;&lt;br /&gt;&lt;em&gt;&lt;span style="font-size:85%;"&gt;&lt;/span&gt;&lt;/em&gt;&lt;br /&gt;&lt;em&gt;&lt;span style="font-size:85%;"&gt;&lt;/span&gt;&lt;/em&gt;&lt;br /&gt;&lt;a target="_blank" href="http://res.sys-con.com/story/nov08/740026/Part1-Figure-6.jpg"&gt;&lt;em&gt;&lt;span style="font-size:85%;"&gt;Figure 6&lt;/span&gt;&lt;/em&gt;&lt;/a&gt;&lt;em&gt;&lt;span style="font-size:85%;"&gt; shows service-data normalization from immature to mature organizations:&lt;/span&gt;&lt;/em&gt;&lt;br /&gt;&lt;br /&gt;&lt;ul&gt;&lt;li&gt;&lt;em&gt;&lt;span style="font-size:85%;"&gt;"Wild West": Non-existent or ad hoc and uncoordinated normalization&lt;br /&gt;&lt;/li&gt;&lt;/span&gt;&lt;/em&gt;&lt;li&gt;&lt;em&gt;&lt;span style="font-size:85%;"&gt;Ownership/Stewardship: Service designs built on data designs&lt;br /&gt;&lt;/li&gt;&lt;/span&gt;&lt;/em&gt;&lt;li&gt;&lt;em&gt;&lt;span style="font-size:85%;"&gt;Encapsulation: Service and data designs coordinated in development/maintenance initiatives; either may drive the other as long as they are coordinated&lt;br /&gt;&lt;/li&gt;&lt;/span&gt;&lt;/em&gt;&lt;li&gt;&lt;em&gt;&lt;span style="font-size:85%;"&gt;Object: One and the same service/data designs. Normalized designs are within EIA designs; service implementations take data ownership to another level where master data value is known only in service designs/implementations.&lt;br /&gt;&lt;/li&gt;&lt;/ul&gt;&lt;/span&gt;&lt;/em&gt;&lt;em&gt;&lt;span style="font-size:85%;"&gt;Most organizations pursuing services-data normalization have progressed to ownership/stewardship levels, yet need to reach encapsulation before realizing major benefits in efficiencies, maintenance costs, and asset business value.&lt;br /&gt;&lt;/span&gt;&lt;/em&gt;&lt;br /&gt;&lt;em&gt;&lt;span style="font-size:85%;"&gt;The highest level of service-data normalization, object, may not make sense for some organizations, especially where master data or business services change frequently. Depending on their stability, the more possible an object level may be. However, cost/benefit analysis may make encapsulation preferred for some organizations.&lt;br /&gt;&lt;/span&gt;&lt;/em&gt;&lt;br /&gt;&lt;em&gt;&lt;span style="font-size:85%;"&gt;Transitioning to advanced service-data normalization is a process of increasing organizational maturity toward coordinated EDM-SOA strategies..."&lt;/span&gt;&lt;/em&gt;&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-8375304026335273256?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/11/case-for-coordinated-edm-and-soa.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-3813964699150286386</guid><pubDate>Sat, 08 Nov 2008 15:33:00 +0000</pubDate><atom:updated>2008-11-08T07:35:44.135-08:00</atom:updated><title>More on LINQ to SQL</title><description>Some additional comments about the &lt;a href="http://blogs.eweek.com/devlife/content/data_access/linq_to_sqls_future.html"&gt;possible end of LINQ to SQL in Julia Lerman's blog&lt;/a&gt;.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-3813964699150286386?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/11/more-on-linq-to-sql.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item><item><guid isPermaLink='false'>tag:blogger.com,1999:blog-7670498351595405283.post-1321161883888258577</guid><pubDate>Fri, 07 Nov 2008 16:14:00 +0000</pubDate><atom:updated>2008-11-07T08:28:31.720-08:00</atom:updated><title>Data Mashups: Enabling Ad-Hoc Composite, Headless, Information Services</title><description>ZapThink just released a research paper about &lt;a href="http://www.zapthink.com/report.html?id=ZAPFLASH-20081107"&gt;Data Mashups&lt;/a&gt;.&lt;br /&gt;Extending the notion of mashups, data mashups will decouple data integration from heavy development cycles. But as ZapThink's Ron Schmelzer wrote this requires to have a strong Data Services Layer in place.&lt;br /&gt;&lt;br /&gt;I fully agree with the following statements from the research:&lt;br /&gt;"&lt;em&gt;...the IT organization must give Service consumers the tools and methods they need to be able to successfully compose those Services with low cost and risk...&lt;/em&gt;"&lt;br /&gt;&lt;br /&gt;And this exactly why &lt;strong&gt;Dynamic Data Services&lt;/strong&gt; are so important. Having statically defined, hard-coded (or visually composed) data services could meet the requirements of statically defined service-oriented processes, but the reactive enterprise needs more flexibility. It is important to have the relevant data services available in real-time when data mashups will require ad-hoc data. A good Data Services Platform must support this kind of runtime generation and deployment of ad-hoc data services.&lt;br /&gt;&lt;br /&gt;Later the author writes:&lt;br /&gt;"&lt;em&gt;...One of the important benefits of a Data Services layer is that it enables loose coupling between the applications using the Data Services and the underlying data source providers. Loose coupling enables data architects to modify, combine, relocate, or even remove underlying data sources from the Data Services layer without requiring changes to the interfaces that the Data Services expose. As a result, IT can retain control over the structure of data while providing relevant information to the applications that need it. Over time, this increased flexibility eases the maintenance of enterprise applications...&lt;/em&gt;"&lt;br /&gt;&lt;br /&gt;In a world where most data sources will become service-oriented (even the databases themselves), it is important to be able to really achieve the decoupling between the data services and the data sources. In this particular case, this requires &lt;strong&gt;extended semantic metadata&lt;/strong&gt; around data services, so that an advanced Data Services Platforms can &lt;strong&gt;dynamically recompose them at runtime&lt;/strong&gt;, as requested by new data mashups.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='http://res1.blogblog.com/tracker/7670498351595405283-1321161883888258577?l=www.dataservices-connection.com'/&gt;&lt;/div&gt;</description><link>http://www.dataservices-connection.com/2008/11/data-mashups-enabling-ad-hoc-composite.html</link><author>noreply@blogger.com (Eric Samson)</author><thr:total xmlns:thr='http://purl.org/syndication/thread/1.0'>0</thr:total></item></channel></rss>