The Data-Centric Revolution: Restoring Sanity to Enterprise Information Systems
Shift from application-centric to data-centric to enable your organization to develop more efficient and successful Enterprise Information Systems.
Software Wasteland: How the Application-Centric Mindset is Hobbling our Enterprises
Know what’s causing application development waste so you can turn the tide.
Waste in the information systems industry
Industries that clean up the waste
A thought experiment on waste
How to spend a billion dollars on a million-dollar system
How to think about information systems resources
How information system costs really behave
Dependency
Redundancy
Complexity
Application centricity and complexity math
Relational databases
ERP systems
Enterprise data modeling
Service-oriented architecture and APIs
Agile
Data warehouse and business intelligence
Outsourcing and offshoring
Cloud
Software as a Service (SaaS)
Data lakes
Machine learning and artificial intelligence
Fallacy # 1: Detailed requirements
Fallacy # 2: Reinvent the wheel
Fallacy # 3: Construction analogy
Fallacy # 4: Estimation by analogy
Fallacy # 5: One neck to choke
Fallacy # 6: Portfolio management
Fallacy # 7: Not in the IT business
How the quagmire looks for government
The death and rebirth of the software industry
Two industries under siege
Outsourcing
Offshoring
The new platform vendors
How application centricity robs productivity
Assessment
Starting to extricate yourself
This movement requires executive sponsorship
If you are not an executive
Data-centric vs. Data-driven
We need our applications to be ephemeral
Data-centric is designed with data sharing in mind
The Data-Centric vision
Evolve-able
Specialize-able
Single but federated
Enterprise app store
Includes all types of data
The economics of the end game
What it requires
Inertial resistance
Overt and covert resistance
What it doesn’t require
This is a program, not a project
The transition requires discipline and consistency
The IT fashion industry
Is the Data-Centric approach a fad?
Can Data-Centric methods benefit from other fads?
From Fad Surfing to New Discipline
New modeling discipline
New delivery architecture
The status quo is getting exponentially worse
Code creates maintenance
Complexity creates high priests
Application-centricity creates silos
Silos create the need for integration
Legacy creates entrenchment
Inflexibility creates shadow IT
Mega projects create mega failures
Where application complexity comes from
A case example in complexity
Separation and isolation
Humans in the loop
The negative network effect
Complexity math and the way out of the quagmire
It’s the data, stupid
Task-centric is a trap
It’s the stupid data
The “what if” view on Data-Centric methods
Fewer models
Simpler models
Integration almost for free
More flexibility
Paradigm shift
The original paradigm shift
How new ideas take hold
Round earth
Heavier than air flight
Scurvy
Hand washing before the germ theory
Non-linear change
Who is not going to help with your transformation?
Digital transformation
The herd
Social proof
Incentives
S&P market intelligence
Sokil
When Linked Data becomes Data-Centric
Separating meaning from structure
A single structure for expressing all data
Graph databases (triple stores) for structures
RDF Resource Description Framework
Global identifiers
Dealing with non-unique but unambiguous IDs
Self-assembling data
Resolvable IDs
Follow your nose
Querying a triple store
Linked data
Metadata is triples as well
Formal definitions
Self-describing data
Schema later
Open world
Local constraints
Curated and uncurated data
Ontologies
Modularity and reuse
Self-policing data
Computable models
Integration with relational
Integration with big data
Natural language processing
Semantic standards stack
Garlik
Montefiore
Isn’t software a good thing?
How much code do we have?
How much do we need?
Where does it all come from?
Reducing schema complexity
Reducing schema variety
Making possible massive reuse
Writing to a subset of the schema
Code reduction through integration elimination
Model-driven development
Low-code and No-code
Declarative code
Model-driven constraints and validation
Model-driven Constraints
Model-driven UI
Model-driven identity management
Model-driven security
Big data
Data lakes
Cloud
NLP
Rule-based systems
Machine learning
Microservices
Kafka
Internet of things
Smart contracts
Accessing your current situation
A small core
Getting to self-funding
Think big and start small
Enterprise ontology
Gist as a starting point for your ontology
Pilots, not POCs
True contingencies
Corporate antibodies
Federated development
An enterprise knowledge graph
The new approach becomes “hot”
The executive’s role in piloting the change
A kinder/ gentler voluntary governance structure
Good, better, best
TBox, CBox, ABox
Share the learning
Data-centric maturity
About Semantic Arts
About the author
This is the book your Systems Integrator and your Application Software vendor don’t want you to read. Enterprise IT (Information Technology) is a $3.8 trillion per year industry worldwide. Most of it is waste.
We’ve grown used to projects costing tens of millions or even billions of dollars, and routinely running over budget and schedule many times over. These overages in both time and money are almost all wasted resources. However, the waste is hard to see, after being so marbled through all the products, processes, and guiding principles. That is what this book is about. We must see, understand, and agree about the problem before we can take coordinated action to address it.
The trajectory of this book is as follows:
This book is the first part of a trilogy to follow Software Wasteland. In Software Wasteland, we detailed the current poor state of application software development. We offered some tactical advice for reducing some of the worse of the excess. This is the first book in the “what to do instead” trilogy.
“Even if the thought of data modeling makes you cringe, Dave McComb’s latest book makes the case that it is a necessary exercise for the data-driven organization. The ‘Data-Centric Revolution’ shows how to be data-driven in an extensible, flexible way that is baked-into organizational culture, rather than taking a typical project-by-project approach. The book is a fun, insightful and meaty read, well-illustrated, and with endless wonderful examples.”
Doug Laney, Principal, Data & Analytics Strategy, Caserta, and author of the best-seller, “Infonomics: How to Monetize, Manage, and Measure Information for Competitive Advantage”
“Dave McComb has laid out a roadmap to travel the exciting path towards data centricity. Dave’s passion for semantic modeling is contagious and his expert advice will give you the motivation to rethink application development and the direction needed to deliver value in your organization with linked data.”
Nic Seyot, Executive Director, Information Management at a major investment bank
“In his new book, Dave teaches us why most of the stack we’ve spent decades trying to maintain is just a big, unmanageable pile of duplicative, inflexible code. He shows us how to collapse the stack and blend the logic and data each business needs to thrive, in one contextually rich, machine readable, dynamic, smart data layer. The bloated app and process layers of the stack go away, leaving a thin execution layer calling on the power of the smart data underneath. After ‘Software Wasteland’ explained the problem, ‘The Data-Centric Revolution’ articulates the solution.”
Alan Morrison, Sr. Research Fellow, New Services and Emerging Tech, PwC
From the age of punched cards to today’s internet-driven systems, one thing has stayed fairly constant: software vendors and their implementers have been driving the Enterprise IT industry. This is changing. It will be hard to see initially, but it’s already happening in some more prescient organizations.
As organizations realize they can take control of their own destiny by adopting data-centric principles, they will see their dependency on application software wither. The cost of running internal information systems will drop at least ten-fold, and the cost of integrating them will drop even more rapidly. This will decimate the $400 billion/ year application software industry and the $400 billion/year systems integration industry. The benefit will accrue to the buyers, and will accrue earliest to the first movers.
The trajectory of this book is as follows:
Dave McComb is the President and co-founder of Semantic Arts, a consulting firm that helps organizations uncover the meaning in the data from their information systems. For 18 years, Semantic Arts has helped firms of all sizes in this endeavor, including Procter & Gamble, Goldman Sachs, Schneider-Electric, Lexis Nexis, Dun & Bradstreet and Morgan Stanley. Prior to Semantic Arts, Dave co-founded Velocity Healthcare, where he developed and patented the first fully model driven architecture. Prior to that, he was part of the problem.
Please complete all fields.