Microsoft

How can we improve Content Moderator?

← Content Moderator

Need better way to distinguish offensive content

Consider the following two tweets. The first is benign. The second is offensive. How can I know that progamatically? They have the same ReviewRecommended, the same Category3 score, low Cat1 and Cat2 scores, and neither have any Terms flagged. This is useless.

{

&quot;OriginalText&quot;: &quot;Wanna win tix to our @RoughTradeNYC show NEXT MON 5/14?  @Thrillcall&#39;s got you covered. Enter to win here &amp;gt;… <a rel="nofollow noreferrer" href="https://t.co/s0KT4JDCB1&quot;">https://t.co/s0KT4JDCB1&quot;</a>,

&quot;NormalizedText&quot;: &quot;Wanna win tix to our @ RoughTradeNYC show NEXT MON 5/ 14? @ Thrillcall&#39; s got you covered. Enter to win here &amp; gt; … <a rel="nofollow noreferrer" href="https://t.co/s0KT4JDCB1&quot;">https://t.co/s0KT4JDCB1&quot;</a>,

&quot;Misrepresentation&quot;: null,

&quot;Classification&quot;:

{

    &quot;ReviewRecommended&quot;: true,

    &quot;Category1&quot;:

    {

        &quot;Score&quot;: 0.001084162387996912

    },

    &quot;Category2&quot;:

    {

        &quot;Score&quot;: 0.13056860864162445

    },

    &quot;Category3&quot;:

    {

        &quot;Score&quot;: 0.98799997568130493

    }

},

&quot;Language&quot;: &quot;eng&quot;,

&quot;Terms&quot;: null,

&quot;Status&quot;:

{

    &quot;Code&quot;: 3000,

    &quot;Description&quot;: &quot;OK&quot;,

    &quot;Exception&quot;: null

},

&quot;TrackingId&quot;: &quot;b1f79713-f84f-47b5-b4d8-0a0d0aec3d73&quot;

}

compare to:

{

&quot;OriginalText&quot;: &quot;@omgimwigs @ me bro fckin @ me 😤🔫🙅🏻&quot;,

&quot;NormalizedText&quot;: &quot;@ omgimwigs @ me bro fckin @ me 😤🔫🙅🏻&quot;,

&quot;Misrepresentation&quot;: null,

&quot;Classification&quot;:

{

    &quot;ReviewRecommended&quot;: true,

    &quot;Category1&quot;:

    {

        &quot;Score&quot;: 0.28458982706069946

    },

    &quot;Category2&quot;:

    {

        &quot;Score&quot;: 0.19746741652488708

    },

    &quot;Category3&quot;:

    {

        &quot;Score&quot;: 0.98799997568130493

    }

},

&quot;Language&quot;: &quot;eng&quot;,

&quot;Terms&quot;: null,

&quot;Status&quot;:

{

    &quot;Code&quot;: 3000,

    &quot;Description&quot;: &quot;OK&quot;,

    &quot;Exception&quot;: null

},

&quot;TrackingId&quot;: &quot;30bf4c39-47ae-4047-8ebb-863486bbabab&quot;

}

1 vote
Sign in
(thinking…)
Sign in with: Facebook Google
Forgot password?
Create a password
Signed in as (Sign out)
Close
Close

We’ll send you updates on this idea

Jeff Lit shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

2 comments

Sign in
(thinking…)
Sign in with: Facebook Google
Forgot password?
Create a password
Signed in as (Sign out)
Close
Close
Submitting...
An error occurred while saving the comment

Content Moderator: Sample Content

Categories

Feedback and Knowledge Base

(thinking…)