Kategorie: AI

Kategorien
AI business IT

Ai and the importance of Data Governance

Data governance and AI are two important concepts that are closely related and can work together in an enterprise to improve the efficiency and effectiveness of business operations. Let me lay out, why there’s no AI powered process without proper data Governance (DG):

What is data Governance?

At a high level, data governance refers to the processes and policies that are put in place to manage and oversee the collection, storage, and use of data within an organization. This can include defining roles and responsibilities for data management, establishing standards and protocols for data quality and security, and implementing systems for monitoring and auditing data usage.

In an enterprise, AI and DG can work together in several ways: For example, data governance can help ensure that the data used for AI models is of high quality and is properly managed and protected. This can involve implementing processes for verifying the accuracy and completeness of the data, as well as setting up systems for securing the data and monitoring its usage.

Additionally, data governance can help to ensure that the AI models being used by the enterprise are fair, ethical, and transparent. This can involve establishing guidelines and protocols for evaluating the performance and biases of AI models, as well as implementing systems for monitoring and auditing their usage.

Here are some examples of how data governance and AI can be integrated in an enterprise:

  • Developing a comprehensive data strategy that outlines the goals and objectives of the organization’s AI initiatives, as well as the roles and responsibilities of various teams and individuals involved in data management and AI development.
  • Establishing clear policies and guidelines for the collection, storage, and use of data, including guidelines for data quality, security, and privacy.
  • Implementing processes for data access and decision-making that ensure that data is used consistently and ethically, and that the organization’s AI models are trained and evaluated on a diverse and representative dataset.
  • Establishing a data governance board or committee that is responsible for overseeing the organization’s data governance and AI initiatives, and for making decisions about the use of AI in the organization.
  • Implementing regular training and education programs for employees on topics related to data governance and AI, to ensure that everyone in the organization is aware of the organization’s policies and practices.

Questions? Comments? Want to chat? Contact me on Mastodon,Twitter or send a mail to ingmar@motionet.de

Kategorien
AI IT my-vpa

AI and Workflow automation – how do they work together?

AI services like Azure, TensorFlow, and Comprehend are becoming increasingly popular among enterprises, as they offer a wide range of benefits. These services can be used to improve workflow automation, allowing businesses to streamline their processes and make them more efficient.

One of the key ways in which AI services can work together with enterprise workflow automation solutions is through the use of standard APIs. E.g. n8n.io provides a standard integration to AWS comprend.

Examples

One example use case for this type of integration is in the field of customer service. AI services like Azure and Comprehend can be used to analyze customer feedback and identify common issues or areas for improvement. This information can then be fed into a workflow automation system, which can automatically route the feedback to the appropriate team or individual for further action – with workflow platforms the information can also directly be fed into tools like slack or mattermost

Another example use case is in the field of finance. AI services like TensorFlow can be used to analyze financial data and identify trends or anomalies that may indicate potential issues or opportunities. This information can then be fed into a workflow automation system, which can automatically generate alerts or take other actions as needed.

Integrations of AI services like Azure, TensorFlow, and Comprehend with enterprise workflow automation like solutions can provide a range of benefits, including increased efficiency, improved customer service, and better decision-making. Standard APIs make it easy to integrate these services into existing systems, providing additional capabilities and enabling businesses to get the most out of their workflow automation solutions. Over at my-vpa.com we are running a large n8n farm in order to automate tasks for ourselves and our customers.

Questions? Comments? Want to chat? Contact me on Mastodon,Twitter or send a mail to ingmar@motionet.de

Kategorien
AI

AWS Comprehend: connecting with python

When you start adding AI services, python is handy to help with simple connection tools. Today: boto3

This is the simple connect I wrote, you can also get it on my github:

#!/usr/bin/python3
# python file to ask amazon comprehend for sentiment
import boto3

# Replace the following with your own AWS access key ID and secret key
aws_access_key_id = "YOUR AWS KEYID"
aws_secret_access_key = "YOUR AWS KEY"

# Create a boto3 client for the Amazon Comprehend API
comprehend_client = boto3.client("comprehend", aws_access_key_id=aws_access_key_id, aws_secret_access_key=aws_secret_access_key)

# Use the Amazon Comprehend API to analyze some text

text = "Danke, das haben Sie gut gemacht."
response = comprehend_client.detect_sentiment(Text=text, LanguageCode="de")

# Print the detected sentiment
print(response["Sentiment"])

Its simple an straight forward. To get it up and runninf have the follwoing prerequsitites in place:

  1. You need AWS console access
  2. Create program based IAM Access to group AWS comprehend edit
  3. Install python3, pip, awscli
  4. Edit .aws config to use a region, e.g. eu-central-1
  5. pip install boto3

Kategorien
AI IT

Now that you want to integrate AI in your custom built software: which are the best OpenSource modelling tools out there?

There are several open source AI model tools available, each with its own unique features and capabilities. Some of the most popular options include TensorFlow, Keras, PyTorch, and scikit-learn.

TensorFlow is a powerful open source library for deep learning, developed by the Google Brain team. It allows users to build and train complex neural network models for a variety of tasks, including image recognition, natural language processing, and time series forecasting. TensorFlow is highly scalable and can be used for both research and production environments.

Keras is a high-level API for building and training deep learning models. It is built on top of TensorFlow and is designed to be easy to use and intuitive for developers who are new to deep learning. Keras allows users to quickly prototype and experiment with different architectures and hyperparameters, making it a popular choice for researchers and data scientists.

PyTorch is another popular open source library for deep learning. It is developed by Facebook AI Research and is designed to be flexible and easy to use. PyTorch allows users to build complex neural network models and perform computations on tensors, a data structure similar to matrices. PyTorch is known for its support for dynamic computational graphs, which allow users to build models on the fly and modify them during training.

scikit-learn is a machine learning library for Python that is widely used in the data science community. It offers a wide range of algorithms for classification, regression, clustering, and dimensionality reduction, along with tools for model evaluation and selection. scikit-learn is designed to be easy to use and can be integrated with other libraries, such as NumPy and Pandas, to create powerful data analysis pipelines.

All of the above are written in python. Pytorch is also ported for JAVA and C++. scikit-learn is also written in Python, but it is focused on traditional machine learning algorithms rather than deep learning.

A difference is the level of abstraction provided by the libraries. TensorFlow and PyTorch offer low-level APIs that allow users to build and customize their own neural network architectures, while Keras provides a higher-level API that allows users to quickly build and train pre-defined architectures. scikit-learn offers a more general-purpose API for traditional machine learning algorithms.

In terms of performance, TensorFlow, Keras, and PyTorch are all optimized for training deep learning models on large datasets and can be used to build models that can run on GPUs and TPUs. scikit-learn is optimized for smaller datasets and can run on CPUs, but it may not be as efficient for larger datasets.

Hope this overview helps to find the model builder you want to go after 🙂

Questions? Comments? Want to chat? Contact me on Mastodon,Twitter or send a mail to ingmar@motionet.de

Kategorien
AI IT

What is the difference of machine learning and deep learning algorithms?

In the process of applying AI to business-usecases, one has to consider two different learning algorithms, which perform significantly better in their specific area:

  1. Machine learning algorithms
  2. Deep learning algorithms

Let’s dig a bit deeper into this:

Machine learning and deep learning are two subfields of artificial intelligence (AI), with deep learning being a subset of machine learning. While both technologies are based on the concept of enabling machines to learn from data, there are key differences between the two that set them apart.

What’s the level of human intervention needed?

One of the main differences between machine learning and deep learning is the level of human intervention required. Machine learning algorithms require human intervention to a certain extent, as they rely on human-defined rules and algorithms to analyze data and make predictions. In contrast, deep learning algorithms are capable of learning on their own, without the need for human intervention. This makes deep learning algorithms more efficient and effective at handling complex tasks and data sets.

What type of data can they handle better?

Another key difference between the two technologies is the type of data they can handle. Machine learning algorithms are typically used to analyze structured data, such as numbers and text. This means that they are well-suited for tasks such as image and speech recognition, where data is already organized in a specific format. In contrast, deep learning algorithms can handle both structured and unstructured data, such as images, videos, and audio. This makes deep learning algorithms better suited for tasks that require the analysis of complex and unstructured data.

Differences in Performance

In terms of performance, deep learning algorithms are generally more accurate and efficient than machine learning algorithms. This is because deep learning algorithms can learn and adapt to complex data patterns and relationships, while machine learning algorithms rely on human-defined rules and algorithms. As a result, deep learning algorithms are better suited for tasks that require high accuracy and precision, such as image and speech recognition.

Example of a machine leraning algorithm

One example of a machine learning algorithm is a decision tree. Decision trees are a type of algorithm that uses a tree-like structure to make predictions based on a set of rules and conditions. The algorithm starts at the root of the tree and follows a series of rules and conditions to make a prediction. For example, in the task of predicting whether a customer will churn or not, a decision tree algorithm might start by evaluating the customer’s tenure with the company. If the customer has been with the company for a long time, the algorithm might conclude that they are unlikely to churn. If the customer has been with the company for a shorter period of time, the algorithm might evaluate other factors, such as their usage of the company’s services, to make a prediction. This process continues until the algorithm reaches a leaf node, where it makes a final prediction. Decision trees are effective at handling structured data and making accurate predictions, but they require human intervention to define the rules and conditions used in the algorithm.

Example of a deep learning algorithm


One example of a deep learning algorithm is a convolutional neural network (CNN). CNNs are a type of deep learning algorithm that is commonly used for tasks such as image and speech recognition. A CNN works by taking an input image and passing it through multiple layers of filters and transformations. Each layer of filters is designed to identify specific patterns and features in the image, such as edges and shapes. As the image passes through each layer, the algorithm learns and adapts to the data, identifying more complex patterns and relationships in the image. This allows the algorithm to make accurate predictions about the content of the image.

Hope this helps a bit to understand the differences 🙂

Questions? Comments? Want to chat? Contact me on Mastodon,Twitter or send a mail to ingmar@motionet.de

Kategorien
AI IT

AI Enterprise Architecture

In Enterprise tech we are entering a new stage of AI being integrated into business processes to leverage its full potential. Therefore Enterprise Architecture has to adapt and embrace AI serivces, models and technology into their frameworks.

What is AI Enterprise architecture?

AI Enterpise architecture is the framework or blueprint that guides the design and implementation of artificial intelligence systems. It defines the components and interactions of an AI system, and outlines the relationships between the different components.

AI Enterprise architecture focuses on the specific components and technologies that make up an AI system. This can include the algorithms and models that are used for machine learning, the hardware and software infrastructure that supports the AI system, and the data sources and storage systems that are used to train and evaluate the AI system.

AI Enterprise architecture is a crucial part of IT enterprise architecture, which is the overall framework for the design and implementation of an organization’s IT systems. IT enterprise architecture provides a common language and set of principles for understanding, designing, and implementing IT systems, and helps to ensure that these systems are aligned with the organization’s business goals and objectives.

The integration of AI Enterprise architecture into IT enterprise architecture can help to ensure that AI systems are designed and implemented in a way that is consistent with the organization’s overall IT strategy. It can also help to ensure that AI systems are integrated seamlessly with the rest of the organization’s IT systems, and can provide the necessary data and resources to support the AI system’s operation.

In addition, technical AI architecture can help to identify potential gaps and overlaps in the organization’s AI capabilities, and can provide a framework for prioritizing and addressing these gaps. This can help to ensure that the organization’s AI investments are focused on the areas that will provide the greatest benefit, and can help to avoid duplication of effort and resources.

In general we can divide AI services into different areas:

  1. integrated AI services like OCR or AI services within software like MS Teams. These are preconfigured services, very spefic to the exact usecase
  2. External cloud based services like Azure Cognitive Services with pre-trained machine learning models that developers can use to add specific capabilities to their applications
  3. Software libraries like tensorflow: TensorFlow is a free and open-source software library for machine learning and artificial intelligence. It was developed by Google and is used by many large companies and research institutions to build and train machine learning models. TensorFlow is particularly well-suited to deep learning, which is a type of machine learning that involves training neural networks on large amounts of data. TensorFlow provides a powerful set of tools for building and training these neural networks, including a library of pre-built neural network modules, algorithms for optimizing the training process, and tools for visualizing and debugging the training process. One of the key features of TensorFlow is that it allows users to build and train machine learning models on a wide range of platforms, including desktop computers, mobile devices, and cloud-based systems. This makes it easy for users to develop and deploy machine learning models in a variety of different environments.

How can companies benefit from a powerful AI Enterprise architecture? As an example: HR

Here are some examples of how AI can be used to improve HR processes and make them more efficient:

  • Recruitment: AI can be used to automate many of the tasks involved in recruiting new employees. For example, AI algorithms can be used to sort through large numbers of job applications and identify the most qualified candidates based on their resumes and other materials. This can save HR professionals a lot of time and effort, and allow them to focus on other important tasks.
  • Employee retention: AI can also be used to help companies retain their best employees. By analyzing data on employee behavior and performance, AI algorithms can identify potential risks of employee turnover, such as low job satisfaction or high levels of stress. This can help HR professionals take proactive steps to address these issues and improve employee retention.
  • Performance management: AI can be used to automate the process of performance evaluations for employees. By analyzing data on employee performance, AI algorithms can provide managers with insights into which employees are meeting their goals and which may need additional support. This can help HR professionals ensure that employees are being evaluated fairly and consistently, and that they have the support they need to succeed.
  • Learning and development: AI can also be used to improve learning and development programs within a company. By analyzing data on employee skills and career goals, AI algorithms can suggest personalized learning paths for employees, helping them to develop the skills they need to advance in their careers. This can help HR professionals provide employees with the support they need to grow and succeed within the company.

As you can see, AI has the potential to greatly benefit HR departments by automating many of the tasks involved in managing employees and improving the efficiency of HR processes. By using AI technologies, HR professionals can save time and effort, and focus on providing the best possible support for employees.

Conclusion

Overall, the integration of technical AI architecture into IT enterprise architecture can help to ensure that AI systems are designed and implemented in a way that is aligned with the organization’s business goals and objectives, and can help to optimize the value of these systems for the organization.

Questions? Comments? Want to chat? Contact me on Mastodon, Twitter or send a mail to ingmar@motionet.de