Skip to main content

Comment Scoring

Evaluate a comment's quality and contribution to the conversation.

What it evaluates:

  • Overall quality (1-5 score): How well the comment engages and contributes
  • Toxicity level (0-1 score)
  • Low effort detection: e.g., "me too", "first"
  • Logical fallacies (ad hominem, straw man, etc.): With educational feedback
  • Objectionable phrases (rude, offensive language): Quoted examples with explanations
  • Negative tone (unconstructive communication patterns): Focused on the quality of communication, not the views themselves

Reference

See the Comment Scoring API Reference for method signatures and parameters.

Response: CommentScore

By Example

Basic Usage

result = client.evaluate_comment(
"Your argument is completely stupid and you clearly know nothing.",
article_id
)

print(f"Overall Score: {result.overall_score}/5")
print(f"Toxicity: {result.toxicity_score:.2f}")
print(f"Low Effort: {result.appears_low_effort}")

# Detailed feedback
for fallacy in result.logical_fallacies:
print(f"\nLogical Fallacy: {fallacy.fallacy_name}")
print(f"Example: {fallacy.quoted_logical_fallacy_example}")
print(f"Suggestion: {fallacy.explanation}")

for phrase in result.objectionable_phrases:
print(f"\nObjectionable: {phrase.quoted_objectionable_phrase}")
print(f"Why: {phrase.explanation}")

for tone in result.negative_tone_phrases:
print(f"\nNegative Tone: {tone.quoted_negative_tone_phrase}")
print(f"Why: {tone.explanation}")

With Reply Context

When a comment is replying to another comment, provide that context:

result = client.evaluate_comment(
"I disagree with your point about type safety.",
article_id,
reply_to_comment="Type hints are unnecessary overhead in Python."
)

Using the Feedback

Respectify is designed to educate and encourage better discussion, not to censor. Respectify encourages friendly (genuine, well-intentioned) disagreement and healthy sharing of different opinions and views. The focus is on the quality of the reply communicating those views, not the views themselves.

We recommend using this not to censor but to educate and encourage better discussion:

  1. Show users the identified issues before they post.
  2. Provide educational feedback: Explain logical fallacies and tone problems.
  3. Give them the opportunity to edit and try again.
  4. Allow multiple attempts: Even very low scored comments can be learning opportunities.
  5. Track improvement: Over time, users will proactively write better comments.

The idea is to guide and educate, helping users improve their discussion skills through feedback.