<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: Parsing Rule and Data Model Rule in Cortex XSIAM Discussions</title>
    <link>https://live.paloaltonetworks.com/t5/cortex-xsiam-discussions/parsing-rule-and-data-model-rule/m-p/1247942#M339</link>
    <description>&lt;P&gt;Hello&amp;nbsp;&lt;a href="https://live.paloaltonetworks.com/t5/user/viewprofilepage/user-id/1401872841"&gt;@A.Velusamy&lt;/a&gt;&amp;nbsp;,&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;P&gt;Greetings for the day.&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;P&gt;In Cortex XSIAM, &lt;STRONG&gt;Parsing Rules&lt;/STRONG&gt; and &lt;STRONG&gt;Data Model Rules&lt;/STRONG&gt; are two distinct mechanisms used to manage and normalize data from third-party sources. Although both rely on Cortex Query Language (XQL), they operate at different stages of the data lifecycle and serve different purposes.&lt;/P&gt;
&lt;H4&gt;&amp;nbsp;&lt;/H4&gt;
&lt;H4&gt;1. Parsing Rules (Ingest-Time)&lt;/H4&gt;
&lt;P&gt;Parsing rules are applied during the &lt;STRONG&gt;data ingestion phase&lt;/STRONG&gt;, before logs are stored in a dataset. Their primary purpose is to clean, filter, and structure raw incoming data.&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;H4&gt;How They Work&lt;/H4&gt;
&lt;P&gt;Parsing rules use a subset of XQL known as &lt;STRONG&gt;XQLi (XQL for Ingestion)&lt;/STRONG&gt;. They process raw log input, perform transformations, and insert the processed results into a specified dataset.&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;H4&gt;Key Functions&lt;/H4&gt;
&lt;H4&gt;Filtering and Cost Reduction&lt;/H4&gt;
&lt;P&gt;You can use the &lt;CODE&gt;filter&lt;/CODE&gt; command within an &lt;CODE&gt;[INGEST]&lt;/CODE&gt; rule to drop unnecessary logs (for example, informational traffic that provides no security value). This helps reduce storage and ingestion costs.&lt;/P&gt;
&lt;H3&gt;Field Extraction&lt;/H3&gt;
&lt;P&gt;Parsing rules extract fields from raw messages (such as Syslog strings) so they are stored as structured columns within the dataset.&lt;/P&gt;
&lt;H3&gt;Timestamp Manipulation&lt;/H3&gt;
&lt;P&gt;Normalizing the &lt;CODE&gt;_time&lt;/CODE&gt; field during ingestion ensures logs are properly ordered and searchable.&lt;/P&gt;
&lt;H4&gt;Effectiveness and Constraints&lt;/H4&gt;
&lt;UL&gt;
&lt;LI&gt;
&lt;P&gt;Parsing rules only apply to &lt;STRONG&gt;new logs ingested after the rule is activated&lt;/STRONG&gt;. They do not modify historical data.&lt;/P&gt;
&lt;/LI&gt;
&lt;LI&gt;
&lt;P&gt;They improve performance because data is pre-parsed and structured before being stored.&lt;/P&gt;
&lt;/LI&gt;
&lt;/UL&gt;
&lt;H4&gt;&amp;nbsp;&lt;/H4&gt;
&lt;H4&gt;2. Data Model Rules (Query-Time)&lt;/H4&gt;
&lt;P&gt;Data Model Rules operate at &lt;STRONG&gt;query time&lt;/STRONG&gt; and provide a normalization layer. They map fields from vendor-specific datasets (for example, &lt;CODE&gt;fortinet_fortigate_raw&lt;/CODE&gt;) to the standardized &lt;STRONG&gt;Cortex Data Model (XDM)&lt;/STRONG&gt;.&lt;/P&gt;
&lt;H4&gt;How They Work&lt;/H4&gt;
&lt;P&gt;Data Model Rules act as a logical “view” on top of your datasets. When you run a query using the &lt;CODE&gt;datamodel&lt;/CODE&gt; command, XSIAM applies these rules to translate vendor-specific field names into standardized XDM field names.&lt;/P&gt;
&lt;H3&gt;Key Functions&lt;/H3&gt;
&lt;H4&gt;Unified Threat Hunting:&lt;/H4&gt;
&lt;P&gt;Enables cross-vendor searches using standardized XDM fields (for example, searching for an IP address using &lt;CODE&gt;xdm.source.ipv4&lt;/CODE&gt; across multiple firewall vendors).&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;H4&gt;Analytics and Correlation:&lt;/H4&gt;
&lt;P&gt;Built-in analytics and correlation rules rely on XDM-normalized fields to detect cross-platform threats consistently.&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;H4&gt;Effectiveness and Constraints:&lt;/H4&gt;
&lt;UL&gt;
&lt;LI&gt;
&lt;P&gt;Data Model Rules are &lt;STRONG&gt;retroactive&lt;/STRONG&gt;, meaning they apply to both historical and newly ingested data.&lt;/P&gt;
&lt;/LI&gt;
&lt;LI&gt;
&lt;P&gt;If you create a user-defined Data Model Rule for a dataset that already has a default rule, the custom rule completely overrides the default rule for that dataset.&lt;/P&gt;
&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;If you feel this has answered your query, please let us know by clicking like and on&amp;nbsp;&lt;STRONG&gt;"mark this as a Solution".&lt;/STRONG&gt;&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;P&gt;Thanks &amp;amp; Regards,&lt;BR /&gt;S. Subashkar Sekar&lt;/P&gt;</description>
    <pubDate>Wed, 11 Feb 2026 14:25:16 GMT</pubDate>
    <dc:creator>susekar</dc:creator>
    <dc:date>2026-02-11T14:25:16Z</dc:date>
    <item>
      <title>Parsing Rule and Data Model Rule</title>
      <link>https://live.paloaltonetworks.com/t5/cortex-xsiam-discussions/parsing-rule-and-data-model-rule/m-p/1238504#M253</link>
      <description>&lt;P&gt;I'm new to Cortex XSIAM..Wanted to understand how effectively parsing rule and Data model rule can be used for a particular data source and how it works?&lt;/P&gt;</description>
      <pubDate>Mon, 22 Sep 2025 11:37:24 GMT</pubDate>
      <guid>https://live.paloaltonetworks.com/t5/cortex-xsiam-discussions/parsing-rule-and-data-model-rule/m-p/1238504#M253</guid>
      <dc:creator>A.Velusamy</dc:creator>
      <dc:date>2025-09-22T11:37:24Z</dc:date>
    </item>
    <item>
      <title>Re: Parsing Rule and Data Model Rule</title>
      <link>https://live.paloaltonetworks.com/t5/cortex-xsiam-discussions/parsing-rule-and-data-model-rule/m-p/1247942#M339</link>
      <description>&lt;P&gt;Hello&amp;nbsp;&lt;a href="https://live.paloaltonetworks.com/t5/user/viewprofilepage/user-id/1401872841"&gt;@A.Velusamy&lt;/a&gt;&amp;nbsp;,&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;P&gt;Greetings for the day.&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;P&gt;In Cortex XSIAM, &lt;STRONG&gt;Parsing Rules&lt;/STRONG&gt; and &lt;STRONG&gt;Data Model Rules&lt;/STRONG&gt; are two distinct mechanisms used to manage and normalize data from third-party sources. Although both rely on Cortex Query Language (XQL), they operate at different stages of the data lifecycle and serve different purposes.&lt;/P&gt;
&lt;H4&gt;&amp;nbsp;&lt;/H4&gt;
&lt;H4&gt;1. Parsing Rules (Ingest-Time)&lt;/H4&gt;
&lt;P&gt;Parsing rules are applied during the &lt;STRONG&gt;data ingestion phase&lt;/STRONG&gt;, before logs are stored in a dataset. Their primary purpose is to clean, filter, and structure raw incoming data.&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;H4&gt;How They Work&lt;/H4&gt;
&lt;P&gt;Parsing rules use a subset of XQL known as &lt;STRONG&gt;XQLi (XQL for Ingestion)&lt;/STRONG&gt;. They process raw log input, perform transformations, and insert the processed results into a specified dataset.&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;H4&gt;Key Functions&lt;/H4&gt;
&lt;H4&gt;Filtering and Cost Reduction&lt;/H4&gt;
&lt;P&gt;You can use the &lt;CODE&gt;filter&lt;/CODE&gt; command within an &lt;CODE&gt;[INGEST]&lt;/CODE&gt; rule to drop unnecessary logs (for example, informational traffic that provides no security value). This helps reduce storage and ingestion costs.&lt;/P&gt;
&lt;H3&gt;Field Extraction&lt;/H3&gt;
&lt;P&gt;Parsing rules extract fields from raw messages (such as Syslog strings) so they are stored as structured columns within the dataset.&lt;/P&gt;
&lt;H3&gt;Timestamp Manipulation&lt;/H3&gt;
&lt;P&gt;Normalizing the &lt;CODE&gt;_time&lt;/CODE&gt; field during ingestion ensures logs are properly ordered and searchable.&lt;/P&gt;
&lt;H4&gt;Effectiveness and Constraints&lt;/H4&gt;
&lt;UL&gt;
&lt;LI&gt;
&lt;P&gt;Parsing rules only apply to &lt;STRONG&gt;new logs ingested after the rule is activated&lt;/STRONG&gt;. They do not modify historical data.&lt;/P&gt;
&lt;/LI&gt;
&lt;LI&gt;
&lt;P&gt;They improve performance because data is pre-parsed and structured before being stored.&lt;/P&gt;
&lt;/LI&gt;
&lt;/UL&gt;
&lt;H4&gt;&amp;nbsp;&lt;/H4&gt;
&lt;H4&gt;2. Data Model Rules (Query-Time)&lt;/H4&gt;
&lt;P&gt;Data Model Rules operate at &lt;STRONG&gt;query time&lt;/STRONG&gt; and provide a normalization layer. They map fields from vendor-specific datasets (for example, &lt;CODE&gt;fortinet_fortigate_raw&lt;/CODE&gt;) to the standardized &lt;STRONG&gt;Cortex Data Model (XDM)&lt;/STRONG&gt;.&lt;/P&gt;
&lt;H4&gt;How They Work&lt;/H4&gt;
&lt;P&gt;Data Model Rules act as a logical “view” on top of your datasets. When you run a query using the &lt;CODE&gt;datamodel&lt;/CODE&gt; command, XSIAM applies these rules to translate vendor-specific field names into standardized XDM field names.&lt;/P&gt;
&lt;H3&gt;Key Functions&lt;/H3&gt;
&lt;H4&gt;Unified Threat Hunting:&lt;/H4&gt;
&lt;P&gt;Enables cross-vendor searches using standardized XDM fields (for example, searching for an IP address using &lt;CODE&gt;xdm.source.ipv4&lt;/CODE&gt; across multiple firewall vendors).&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;H4&gt;Analytics and Correlation:&lt;/H4&gt;
&lt;P&gt;Built-in analytics and correlation rules rely on XDM-normalized fields to detect cross-platform threats consistently.&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;H4&gt;Effectiveness and Constraints:&lt;/H4&gt;
&lt;UL&gt;
&lt;LI&gt;
&lt;P&gt;Data Model Rules are &lt;STRONG&gt;retroactive&lt;/STRONG&gt;, meaning they apply to both historical and newly ingested data.&lt;/P&gt;
&lt;/LI&gt;
&lt;LI&gt;
&lt;P&gt;If you create a user-defined Data Model Rule for a dataset that already has a default rule, the custom rule completely overrides the default rule for that dataset.&lt;/P&gt;
&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;If you feel this has answered your query, please let us know by clicking like and on&amp;nbsp;&lt;STRONG&gt;"mark this as a Solution".&lt;/STRONG&gt;&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;P&gt;Thanks &amp;amp; Regards,&lt;BR /&gt;S. Subashkar Sekar&lt;/P&gt;</description>
      <pubDate>Wed, 11 Feb 2026 14:25:16 GMT</pubDate>
      <guid>https://live.paloaltonetworks.com/t5/cortex-xsiam-discussions/parsing-rule-and-data-model-rule/m-p/1247942#M339</guid>
      <dc:creator>susekar</dc:creator>
      <dc:date>2026-02-11T14:25:16Z</dc:date>
    </item>
  </channel>
</rss>

