GenAI Protect

GenAI Protect allows administrators to keep track of the generative AI tools used in the organization. It provides visibility of all the shadow AI tools used in the organization and helps in Data Loss Prevention. It assesses each user session for risks based on context, content type, sensitivity, user behavior and blocks risky activities. It provides advanced risk assessment to stay secure and compliant.

Benefits

  • Increased Visibility - Provides complete visibility into the GenAI tools used across the organization, their purposes, and associated risks.

  • Informed Governance - Provides insights into your organization's top GenAI use cases, helping you take informed policy and investments decisions.

  • Data Loss Prevention - Uses AI-driven data classification to minimize data leakage risks and also helps to strengthen security.

  • Regulatory Compliance - Logs all user activities to ensure regulatory compliance and helps in audit trial.

GenAI Protect Dashboard

The GenAI Protect Dashboard provides detailed overview of security risks, and sensitive data exposure to the AI tools used in your organization. By continuously monitoring sensitive content and identifying use case patterns, it provides insights into individual user sessions and helps administrators assess vulnerabilities, address potential risks, and ensure better security and effective AI utilization.

To view the GenAI Protect Dashboard, access the Harmony SaaSAdministrator Portal and click Overview > GenAI Protect.

Extending the Time Frame of the Analytics

By default, the GenAI Protect Dashboard shows analytics for the last 30 days.

To view analytics for specific time periods, select a time frame from the drop-down at the top of the page.

  • Last 7 days

  • Last 14 days

  • Last 30 days

Risky Sessions by App

The Risky sessions by app widget shows the number of user sessions and their associated severity levels for various generative AI tools used within in the selected time frame.

  • Critical

  • High

  • Medium

  • Low

  • Very low

  • None

To view detailed information about a specific AI tool or an application, click on the relevant name in the widget, and the system shows risk assessment specific to the application. For more information, see Application Risk Assessments.

Use Cases

The Use Cases widget shows the total number of sessions where GenAI Protect categorized user activity into one of these use cases within the selected time frame.

Use Case

Description

Algorithm Development

Develop algorithms for various tasks.

Audio Analysis

Analyze audio data and extract insights.

Audio Generation

Generate audio content based on input.

Coding

Generate code snippets based on user input.

Content Generation

Generate content for various platforms.

Copy Writing

Create persuasive text for advertisements or marketing.

Customer Support

Assist customers with their queries and issues.

Data Analysis

Analyze data and generate insights.

Debugging

Help in debugging code and finding issues.

Design

Generate design concepts and ideas.

Documentation

Create and manage technical documentation.

Email & Communication

Draft emails and other forms of communication.

Financial Analysis

Analyze financial data and generate reports.

Grammar

Check and correct grammar in text.

Image Editing

Edit and improve images.

Image Generation

Generate images based on input.

IT Assistance

Provide IT support and assistance.

Legal Review

Review and analyze legal documents.

Market Analysis

Analyze market trends and data.

Marketing Content

Create marketing content for various platforms.

Medical Advice

Provide medical advice and information.

Patent Review

Review and analyze patents.

Personal Advice

Provide personal advice on various topics.

Presentations Generation

Generate presentations based on input.

Product Recommendation

Recommend products based on user input.

Prompt Engineering

Design effective prompts for models.

Research

Conduct research and gather information.

Sales Forecasting

Predict future sales based on historical data.

Script Generation

Generate scripts for various purposes.

Storytelling

Create and tell stories.

Text Editing

Edit and improve written text.

Text Summarization

Summarize long texts into concise formats.

Translation

Translate text from one language to another.

Transcript

Create transcripts from audio or video.

Troubleshooting

Identify and solve problems.

UX/UI Generation

Create UX/UI designs.

Video Editing

Edit and improve video content.

Video Generation

Generate video content based on input.

For example, a user may ask GenAI to summarize an email, conduct research, write code, or perform market analysis. GenAI Protect identifies the relevant use cases from the user input and categorizes the activity accordingly.

Sensitive Content

The Sensitive content widget shows the total number of user sessions where sensitive information is exposed to the generative AI tools in the selected time frame.

GenAI Protect uses the Sensitive content widget as a discovery dashboard, operating independently of the configured DLP policies. Instead of filtering results by specific content types, it analyzes contextual data across all these use cases.

  • Personal Identifiable Information

  • Network & IT

  • Credentials

  • Source Code

  • Legal documents

  • Business & strategy

  • Customer Information

  • Employee Information

  • Financial Information

  • Protected Health Information

For discovery purposes, GenAI Protect treats all prompts as potentially sensitive and retrieves data from all available content categories. It then evaluates the discovered information to determine whether it contains elements matching the use cases, such as PII, credentials, or network details.

Total Sessions

The Total sessions widget shows the total number of user activities monitored by GenAI Protect in the selected time frame.

The Total sessions table shows information about user activities across various generative AI applications, including their severity levels and use cases, in the selected time frame.

Column

Description

Session risk

Severity level of the user session.

  • Critical

  • High

  • Medium

  • Low

  • Very low

  • None

Application

Name of the generative AI application.

Click on the application name to view analytics specific to the application. For more information, see Application Risk Assessments.

Description

Description of the session's action.

Click More for detailed information about the user session. For more information, see Session Overviews.

Use cases

Names of the use cases associated with the session.

Sensitive content

The type of sensitive information exposed during the session.

Users

Name of the user involved in the session.

Date & Time

The date and time when the user session occurred.

Applications

The Applications widget shows the total number of applications detected as used by the users in the selected time frame.

The Applications table shows detailed insights into user activities in various generative AI applications, including their severity levels, use cases, sensitive content, and content sources.

By default, the table shows the applications sorted by app risk.

Column

Description

Application

Name of the used generative AI application.

Click on the application name to view analytics specific to the application. For more information, see Application Risk Assessments.

App risk

Severity level of the detected application.

  • Critical

  • High

  • Medium

  • Low

  • Very low

  • None

For more information, see How GenAI Protect assesses the risk of an application.

Users

Number of users using the application in the organization.

Sessions

Number of user sessions associated with the application.

Sensitive content

Number of user sessions where sensitive information is entered in the application.

Use cases

Number of use cases associated with the application.

Content sources

Number of external websites from which the data is copied from to the app.

Last used

Date on which the application was recently used in the organization.

First used

Date on which the application was used for the first time in the organization.

Sensitive Categories

The Sensitive categories widget shows the total number of categories of sensitive information detected in the user sessions by GenAI Protect in the selected time frame.

The Sensitive categories table shows the categories of sensitive information and their details, including the number of users and sessions involved in each category in the selected time frame.

Column

Description

Sensitive content

Type of sensitive information.

To view user sessions specific to a content type, click on the sensitive content name. The system opens a right-pane and shows the analytics filtered specifically for that category. For more information, see Total Sessions.

Sessions

Number of sessions associated with the sensitive category.

Users

Number of users that entered prompts or information which included the sensitive category.

Last seen

Date on which the category was last detected.

Use Cases

The Use Cases widget shows the total number of different use cases detected in the user sessions by GenAI Protect in the selected time frame.

The Use Cases table shows the number of sessions, and users involved in a specific use case and their details in the selected time frame.

Column

Description

Use case

Name of the use case.

Click on the use case name to view analytics filtered specifically for the use case. The system opens the sessions pane to the right and shows the relevant information. For more information, see Total Sessions.

Sessions

Number of user sessions associated with the use case.

Users

Number of users that entered prompts or information which included the use case.

Last seen

Date on which the use case was last detected.

User Sessions

The User Sessions widget shows the total number of users that used different generative AI applications in the selected time frame.

The User Sessions table shows detailed insights into user activities in various generative AI applications, including the sessions count, use cases, and sensitive content, as detected in the selected time frame .

Column

Description

User

Name of the user.

Click on the user name to view analytics specific to the user. For more information, see Monitoring User Activities.

Riskiest session

Highest severity level of all the sessions by the user.

Applications

Different generative AI applications used by the user.

Click on the application logo to view information specific to the application. For more information, see Application Risk Assessments.

Sessions

Number of sessions involving the user.

Use cases

Names of the use cases detected in the prompts or information entered by the user.

Sensitive content

Sensitive content types detected by GenAI Protect in the sessions involving the user.

Filtering the Sessions

In the Gen AI Protect Dashboard tables, you can search and filter specific sessions.

To filter the list of sessions, do one of these:

  • Use the free text search for strings across all fields.

  • To filter sessions for a specific type, click the (Filters) icon and select the required fields.

To sort the table, click the name of the column.

To filter the table to show specific columns, click the icon and select the relevant columns.

To clear the filters, click Clear.

Application Risk Assessments

To view information about a specific generative AI application, click on the required application name in the Application column of the Total Sessions table. GenAI Protect redirects you to the relevant risk assessment dashboard.

Widget Name

Description

Application name

The name and description of the application.

Type

The type of application. See List of supported Category / Type for Generative AI applications.

Category

The category of sensitive information exposed to the application. See List of supported Category / Type for Generative AI applications.

Sessions count

The total number of sessions in the application.

Users count

The total number of users interacting with the application.

Risk assessment

The percentage of the application's overall risk level in the organization.

For more information, see How GenAI Protect assesses the risk of an application.

First used

The date of the application's initial activity within the organization.

Last used

The date of the application's most recent activity within the organization.

Publisher

Name of the AI application publisher.

Tags

Shows a tag if the application will be trained on the user data according to the privacy policy of the application.

Website

A link to the selected AI application’s website.

Security overview

The total number of certifications associated with the application as detected by GenAI Protect.

To view the application's certifications, privacy statements, and terms of use, click the icon.

GenAI security:

  • Risky sessions

The ratio of risky activities to the total risk sessions for the selected AI application.

To view session risks, sensitive content, and use case details specific to the AI application, click the icon.

  • Sessions risk: Severity level of the sessions in the selected application.

    • Critical

    • High

    • Medium

    • Low

    • Trivial

    • None

  • Sensitive content: The total number of sessions where sensitive information is exposed within the organization in the selected AI application.

  • Use cases: The total number and percentage of instances of AI tools used within the organization by different types in the selected AI application.

Total sessions

The Total sessions widget displays the total number of monitored risky AI activities for the selected AI application.

The Total sessions table provides information about user activities in the selected AI application, including detected severity levels and use cases. See Total Sessions.

List of supported Category / Type for Generative AI applications

Category

Type

Adult

Sexual Content

Other

Collaboration

File Sharing

Presentation & Learning Tools

Tasks & Project Management

Team Communication

Time Management & Calendars

Video Conference & Online Meetings

Communication

Social Media

Data

AI & Machine Learning

GenAI

General

Development

Code Review

General

Graphics & Design Software

Localization & Geo-coding

Product Management & UX

HR

CV & Background Checks

Vocational Training & Online Courses

Interests

Books & Arts

Dating

Education

Health & Fitness

Music, Media & Streaming

Other

Marketing

Advertisement & SEO

Email Marketing

General

Website Builders & Web Hosting

Productivity

Converters & Viewers

Email Clients & Personalization

General

Image & Video Editing

Productivity

PDF Edit, Fill & Sign

Spreadsheet Tools

Translation & Transcribing

Workflow Automation

Writing Revision & Auto-Correction

Sales

General

Sales Engagement

Session Overviews

To view specific session details, click More for the required description in the Description column of the Total Sessions table.

The Session overview provides more detailed insights for the selected session.

Widget Name

Description

Session date

Date on which the user session was performed.

Sensitive prompts

Types of sensitive information exposed in the session.

User action

The action taken by the user during the session. It shows if the user pasted the text or not.

User

The name of the user involved in the session.

Use cases

Names of the use cases associated with the session.

Content source The source of the content in the session.
Risk assessment The risk level assessed by GenAI Protect for the session.

Description

A detailed description of the session.

  • If no risk is detected in the session, the system shows The prompt does not contain sensitive information.

  • If risk is detected in the session, the system shows only the high level description by excluding the sensitive information, protecting the privacy of the user.

Prompt

The prompt used in the session.

To view the prompt, Click here to view prompt.

Note - This feature is disabled by default. To have permissions to view the prompts, you must have Admin Sensitive Data permissions.

For more information, see Assigning Admin Sensitive Data permissions to an administrator.

Monitoring User Activities

To view specific user activities, click on the user name in the Users column of the Total Sessions table. The user window appears in the right pane and provides analytics specific to the user activities.

Widget Name

Description

Applications

The total number of applications the user is interacting with.

Total sessions count

The total number of user sessions involving the user.

Use cases

The total number of use cases associated with the user.

Risky sessions breakdown

The total number of risky sessions involving the user.

  • Critical

  • High

  • Medium

  • Low

  • Trivial

User Activity Table

The user activity table provides detailed insights into the activities of the selected user.

Column

Description

Risk

Severity level of the session.

  • Critical

  • High

  • Medium

  • Low

  • Very low

  • None

Application

Name of the application in use.

Use cases

Names of the use cases associated with the session.

Sensitive content

Types of sensitive information exposed in the session.

First used

Date on which the activity was performed.

How GenAI Protect assesses the risk of an application

GenAI Protect assesses the risk of an application based on:

  • Publisher

  • Compliance

  • Security overview

Generating Reports

GenAI Protect allows you to download reports for these time periods:

  • Last 24 hours

  • Last 7 days

  • Last 30 days

To download a report:

  1. Log in to the GenAI Protect page.

  2. From the top right corner, click the dropdown and select the time period for the report.

    • Last 24 hours

    • Last 7 days

    • Last 30 days

  3. Click Download Report.

Note - The system takes up to 2 minutes to generate the report and automatically downloads it.

Assigning Admin Sensitive Data permissions to an administrator

By default, all the administrators are not provided with the permissions to view the prompts used by the users. This is to ensure that only specific administrators can view the sensitive prompts.

To view the prompts entered by the users, you must assign Admin Sensitive Data specific service role to the administrators.

To assign Admin Sensitive Data Specific Service Role to an administrator:

  1. Log in to the Infinity Portal.

  2. Click Settings > Users.

  3. Select the user and click Edit from the top of the page.

  4. Go to Specific Service Roles section and do these:

    Assigning Admin Sensitive Data to SaaS

    1. In the Service list, select SaaS.

    2. In the Specific service role(s) list, select Admin Sensitive Data.

  5. Click Save.