Technology Dispatch is an online platform that delivers the latest news and insights on technology, innovation, and the digital world. From AI and machine learning to cybersecurity and the Internet of Things, Technology Dispatch covers the technologies that are shaping our future.The website publishes news, press releases, opinion and advertorials on various financial organizations, products and services which are commissioned from various Companies, Organizations, PR agencies, Bloggers etc. These commissioned articles are commercial in nature. This is not to be considered as financial advice and should be considered only for information purposes. It does not reflect the views or opinion of our website and is not to be considered an endorsement or a recommendation. We cannot guarantee the accuracy or applicability of any information provided with respect to your individual or personal circumstances. Please seek Professional advice from a qualified professional before making any financial decisions. We link to various third-party websites, affiliate sales networks, and to our advertising partners websites. When you view or click on certain links available on our articles, our partners may compensate us for displaying the content to you or make a purchase or fill a form. This will not incur any additional charges to you. To make things simpler for you to identity or distinguish advertised or sponsored articles or links, you may consider all articles or links hosted on our site as a commercial article placement. We will not be responsible for any loss you may suffer as a result of any omission or inaccuracy on the website
Home Digital Observability pipelines and AIOps – using data in the right way to ensure the UK’s National AI Strategy is a success

Observability pipelines and AIOps – using data in the right way to ensure the UK’s National AI Strategy is a success

by Jessica Weisman-Pitts
0 comments
iStock 12940218511

By Nick Heudecker, Senior Director, Market Strategy,Cribl

TheNational AI Strategy is an ambitious project. Building upon the UK’s current strengths in the sector, within ten years the Government wants the impact and benefits of artificial intelligence to be felt across the country. The strategy states that “the UK government sees being competitive in AI as vital to our national ambitions on regional prosperity and for shared global challenges such as net zero emissions, health resilience and environmental sustainability”.

With this aim, the National AI Strategy identifies several areas of key focus. These include attracting the right talent and development of AI skills, participating in international research initiatives, specialisedfinance and VC programmes as well as access to data and data policy frameworks.

Importantly, both the private and public sectors are being encouraged to make the most of new tools to help turn Britain into an AI superpower and gain an edge on the world stage.

Where should businesses start?

AI-augmented design, physics-informed AI, AI-driven innovation amongst others all feature onGartner’s 2021 Hype Cycle for Emerging Technologies. While certainly exciting and promising, the practical implementation of these technologies for most organisations will likely seem somewhat distant.

The best place to start with implementing AI into an organisation is by identifying where it can have the biggest impact on empowering the workforce whilst also fitting seamlessly into current processes and enhancing operations.

With the encouragement of the National AI Strategy, many enterprises will likely start their AI journey by exploring the use of AI for IT Operations (AIOps) to improve processes by reducing alert fatigue, proactively detecting performance problems and avoiding outages. This is one area that will likely receive significant attention throughout the National AI Strategy’s ten-year timeline and is where businesses can make a lot of early gains.

However, examples of successful AIOps are hard to come by and could be in danger of becoming an unfortunate joke. The truth is that deploying AIOps requires access to huge amounts of operational data. Making sense of such datasets isn’t simple, and a one-size fits all approach to automating processes, detecting data anomalies, and determining causality simply isn’t practical. In fact, a one-size fits all approach is doomed to fail.

The power of observability in making AIOps a success

To be successful, AIOps tools need the flexibility to ingest and index data from many sources. These include infrastructure, networks, applications, a range of monitoring tools, and deployed software agents. All data from these diverse sources must be normalised before it can be used for either real-time analytics over data in flight or for historical analysis over larger datasets at rest.

Successfully deploying AIOps into the enterprise means managing three core constraints: volume, accuracy, and precision:

  1. Volume – vast amount of operational data flow out of systems in hundred of different formats over dozens of protocols. The problem is that this data isn’t effective for AIOps. Even with the collection of huge terabytes and petabytes of telemetry data, there’s a shortage of high quality, representative data for AIOps.
  2. Accuracy – with the variety of data sources consumed, ensuring consistent data quality and integrity is essential to model performance. Data quality impacts all types of artificial intelligence projects, not just AIOps. According to a recent survey, 87% of data professionals are concerned about data quality impacting their AI implementations.
  3. Precision – model iteration is an important part of AI implementation. Successful iteration not only requires running multiple tests with the same parameters and data sets, but it also involves evaluating the variability between tests to ensure ongoing precision of the tools you’re putting in place. Without effectively managing the volumes of data and ensuring their accuracy, your AIOps tools can’t achieve reliable levels of precision.

If you want value from AIOps you need to understand the data and, as is evident, the problem for realising successful AIOps is often the data it relies on.

One way around this problem is the use of unified observability pipelines. These pipelines drive operational efficiencies by getting the right data, to the right destinations – in the right formats – at the right time. As a result, businesses can more effectively realise digital transformation initiatives, slash costs and improve performance.

Observability pipelines provide the much-needed control enterprises must have over their data to make AIOps a success. Deploying effective AIOps requires accurate data from across your monitoring infrastructure formatted for your AIOps platforms. An observability pipeline unlocks data from silos and provides a single point for data enrichment, filtering, refinement, and routing to any AIOps platform a team uses.

By unlocking data from silos and providing a single point for data enrichment, filtering, refinement, and routing to any AIOps platform, observability pipelines will help put many UK organisations on the front foot when it comes to realising the full benefits of transitioning to a leading AI-enabled economy.

Recent Post
cropped user

Jesse Pitts has been with the Global Banking & Finance Review since 2016, serving in various capacities, including Graphic Designer, Content Publisher, and Editorial Assistant. As the sole graphic designer for the company, Jesse plays a crucial role in shaping the visual identity of Global Banking & Finance Review. Additionally, Jesse manages the publishing of content across multiple platforms, including Global Banking & Finance Review, Asset Digest, Biz Dispatch, Blockchain Tribune, Business Express, Brands Journal, Companies Digest, Economy Standard, Entrepreneur Tribune, Finance Digest, Fintech Herald, Global Islamic Finance Magazine, International Releases, Online World News, Luxury Adviser, Palmbay Herald, Startup Observer, Technology Dispatch, Trading Herald, and Wealth Tribune.