Message Size Limit
Log line is limited to 50,000 characters. If the message's size goes over 50K characters, Scalyr splits the message into multiple lines.
WARNING: The message which is split up might not be parsed correctly. As a result, the lines may not be grouped together on the UI. We encourage our users to avoid sending blobs of data to Scalyr if they can clean up the log's format within their applications.
Account Parsed Field Limit
There are two attribute limits per account in Scalyr;
- Total number of attributes
- The number of dynamic attributes
The maximum number of attributes allowed per account is 4000. Scalyr calculates the total number of attributes from all hosts/log files of each account every 5 minutes. The system discards additional attributes if the total number of attributes goes over 4000. This counter resets every 5 minutes.
The other field limit is called the dynamic attribute limit. This is the limit enforced for key-value pairs, fields extracted from a JSON object, etc. The dynamic attribute limit is 300 per account. This limit can be expanded upon request.
Pro tips: Searching for
$tag == "attributeLimitInfo" to verify if your account reaches the attribute limit. The search's response should include an
attributeCount attribute which shows the number of attributes within its assigned 5-minute interval. If we had to discard any attributes, then there will be some additional fields:
discardedAttributes– the number of unique attributes which were discarded (i.e. how many different attribute names)
discardedAttributeInstances– the number of discarded attribute instances. If we discard attributes "x" and "y" from 10 events, this will be 20 but
discardedAttributeswill be 2.
eventsWithDiscardedAttributes– the number of events which had at least one discarded attribute
sampleDiscardedAttribute– the name of one of the discarded attributes. Looking at these values might give us a general idea of which attributes are causing trouble.
$tag == "attributeLimitInfo" only returns a result if your account is above half of the limit. This feature allows you to directly view the number of attributes you're using.