TweetShareSharePin0 SharesWrap-up This is the last post in this series and I’ll not introduce anything new here, but rather just summarise the changes explained and talk a bit about the value the solution delivers to the organisation. Let’s first review the situation we faced before implementing the changes. The cost of writing the log-records to the database was that all the parallel writing from many different sources was such that it introduced severe bottlenecks to the point that the logging feature […]
Tag: Partitioning
Improving data move on EXADATA IV
TweetShareSharePin0 SharesReducing storage requirements In the last post in this series I talked about how we sped up the move of data from operational to historical tables from around 16 hours down to just seconds. You find that post here. The last area of concern was the amount of storage this took and would take in the future. As it was currently taking 1.5 TB it would be a fairly large chunk of the available storage and that raised concerns […]
Improving data move on EXADATA III
TweetShareSharePin0 SharesMoving to history tables In the last post I talked about how we made the speed of actually writing all those log-records much faster. It has to date been so fast that no a single report of a problem has been filed. you find that post here. Once the data was written to the log-tables, it had to be moved to the history tables.This was a process that took around 16 hours. It was never allowed to run for […]
Improving data move on EXADATA II
TweetShareSharePin0 SharesWriting log records The last post in this series introduced the problem briefly. You find that post here. In this post I’ll talk about the changes made to make that writing of log records fast enough. There were 50 million records that was written. Each of them pretty much in its own transaction. Of course the commit activity caused problem, as did log buffer issues. Some of this could be somewhat remedied with configuration. The big issue though was that […]
Faster data move on EXADATA I
TweetShareSharePin0 SharesIntroduction In my work among other things I tune and tweak solutions for EXADATA. Today I’ll write about a big improvement we achieved with a process that moves data from the operational tables to the ones where the history is stored. This will not be a technical post. While I talk about using advanced technologies, I will not discuss code or deep details of them in this post. And yes, when I say post, I mean a series of […]