Microsoft

How can we improve Microsoft Cognitive Services?

Truncated input to first 100 tokens during analysis

I got an error message from Text Analytics Sentiment
"Truncated input to first 100 tokens during analysis".

How fix it?

1 vote
Sign in
Check!
(thinking…)
Reset
or sign in with
  • facebook
  • google
    Password icon
    Signed in as (Sign out)

    We’ll send you updates on this idea

    Anonymous shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

    1 comment

    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      Signed in as (Sign out)
      Submitting...
      • Assaf Israel [MSFT] commented  ·   ·  Flag as inappropriate

        Note that this is a warning, not an error. Your document was still processed, but it was scored based on the first 100 tokens of the problematic sentence.

        This error happens when the input contains a sentence with over 100 tokens (words) which usually suggest the data does not contain natural language text (e.g. encoding issues, HTML or binary content, etc).

      Feedback and Knowledge Base