r/modhelp•
RandoTurk

Disable random bots from using the API to scrape the sub?

Tools

A friend modding a small subreddit is asking me for help.

She's getting some bot traffic scraping her sub for content, so we don't know the username or anything for these bots since they're only viewing it. Was wondering if there's a way to disable non approved bots/non-mods from using reddit's API and .json pages, or ways lower the rate limits for the sub to a snail's crawl or something.

Thank you for any possible insights and solutions!

Posted Jan 16, 2022, 7:00 AM UTC

1015
Generic_Mod•

I don't think there's any way to do this other than setting the sub to private and then approving the users you want to give access.

12
RandoTurkOP•

I was hoping another alternative. Thank you though.

3
nightcom•

I'm not on any side just wondering if sub is public, content also so whats the problem if some bot is scraping the sub? Let it scrap or make sub private if she don't want content to be public - is there any technical problem because of this bot?

3
RandoTurkOP•

There's limited number of uses for the links given out, so the bot owners repost to their discord taking away uses from human subscribers on Reddit. The links generally last hours, but lately have been used up in minutes.

2
alexklaus80•

Is that something like the post with link for first come first serve limited offer?

3
RandoTurkOP•

Something like that.

2
alexklaus80•

Ah. In that case then, I think you'll need to come up with some way to add the extra layer in expense of current local reddit user's convenience. For example, provide link to send DM in certain format which will be replied by bot providing the said link.

I don't know too much about bot's capability, but I believe it can check if the sender is subscribed to your sub before responding to the request. (If that's the case then it can encourage non-subscribed guests from Discord to subscribe to your sub and retry.)

Obviously, it won't prevent anyone from sharing that very url, but the idea is to add enough complexity to discourage them from doing that. If you want to make it harder then I think you're going to need to implement features on the application behind the link (such as checking if the visitor of the link should be approved or not based on the url or other credentials).

3
nightcom•

Ohh that make sense, tough case I guess but I don't see also other option then make it private or increase link limit. I hope on end she will be happy

2
RandoTurkOP•

Not within our ability to increase the giveaway limits. I'm thinking private too.

Had this problem with Facebook page and telegram too.

2
AutoModeratorMOD•

Hi u/RandoTurk, please see our Intro & Rules. We are volunteer-run, not managed by Reddit staff/admin. Volunteer mods' powers are limited to groups they mod. Automated responses are compiled from answers given by fellow volunteer mod helpers. Moderation works best on a cache-cleared desktop/laptop browser.

Resources for mods are: (1) r/modguide's Very Helpful Index by fellow moderators on How-To-Do-Things, (2) Mod Help Center, (3) r/automoderator's Wiki and Library of Common Rules. Many Mod Resources are in the sidebar and >>this FAQ wiki<<. Please search this subreddit as well. Thanks!

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1
AutoModeratorMOD•

Found regex match: approved

It looks like you're asking about approving posts or users. These are frequently-asked questions.

FOR INFO ON: # approving posts/users, # how to do it, # what it means, # why posts/comments are marked as spam (spam filter settings), # how to set all posts/comments to need mod approval, # shortcuts to approving posts/users, please click here.

Subreddit settings work best in a cache-cleared desktop browser. (Limited option: mobile browser on desktop view.)

If you found your answer, feel free to reply with "<3 Automod" or "Thanks, Automod". Otherwise wait for a human helper to come along to help you. This post has NOT been removed.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1
AutoModeratorMOD•

Found regex match: bot

Hi there! I am AutoModerator. It seems you are asking about me or my fellow bots and what we can do.

FOR INFO ON: # how to invite and set up, # common AutoMod rules for age/karma/comments/detect link or words, # "Code won't save"/"Something went wrong", # post/comments being marked as spam, # scheduling posts, and # other bots and their functions, please click here.

There is a dedicated subreddit for me, AutoModerator, at r/automoderator. Please search that subreddit first, then ask questions about AutoMod Rules over there or in this subreddit.

Subreddit settings work best in a cache-cleared desktop browser. (Limited option: mobile browser on desktop view.)

<3 xoxo

If you found your answer, feel free to reply with "<3 Automod" or "Thanks, Automod". Otherwise wait for a human helper to come along to help you. This post has NOT been removed.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1
[deleted]•

[removed]

-7