logo
down
shadow

Reddit data scraping with json, 'after' not making a difference in '.json?limit=<limit>&after=<id>'


Reddit data scraping with json, 'after' not making a difference in '.json?limit=<limit>&after=<id>'

By : Khad
Date : November 18 2020, 03:49 PM
Hope this helps The id shouldn't be appended to after=, but rather the value of attribute data-fullname="", listed as name in the returned json, which will usually have two characters, an underscore, then the post's id, e.g. t3_2qpfcs.
code :


Share : facebook icon twitter icon
JSON / PHP data limit in Android

JSON / PHP data limit in Android


By : B. Bus
Date : March 29 2020, 07:55 AM
Does that help More than likely, the data being sent via POST is too large for the server to handle. You will need to increase the maximum post size by adding it to your php.ini or .htaccess file.
.htaccess example:
code :
php_value upload_max_filesize 20M
php_value post_max_size       20M
JSON data limit?

JSON data limit?


By : Mayur kadam
Date : March 29 2020, 07:55 AM
like below fixes the issue Your problem is not connected to JSON. Your problem is caused by the fact that data comes in separate chunks and you are trying to parse each chunk as a single JSON object.
You have to join the data chunks into one NSData object (-[NSMutableData appendData:]) and then use a JSON parser to parse them.
JSON Data Limit

JSON Data Limit


By : a.tkvs
Date : March 29 2020, 07:55 AM
wish help you to fix your issue We found that the html "input" has a hard limit of 512 KB. Ideally, we should have received some kind of error/warning when trying to assign more data to an input value through JS. However, that does not happen
So we changed the input which was previously defined as:
code :
<input type="text" style="visibility: hidden" name="testResults" id="testResults"/>
<textarea style="visibility: hidden" name="testResults" id="testResults"/>
64k limit on json data for urlopen

64k limit on json data for urlopen


By : Frankgrandson
Date : March 29 2020, 07:55 AM
To fix the issue you can do An HTTP 500 error indicates an "internal server error". In theory, this means that there is not a problem with your code, there is a problem with the server.
In practice, an HTTP 500 error can mean almost anything, because many servers will use HTTP 500 as the default error code when a more specific error code is not provided by the programmer. Unfortunately, this means you are reduced to making guesses at how somebody else's code works.
code :
import gzip
import json

# Remove whitespace from JSON
json_string = json.dumps(
    json.loads(json_string),
    separators=(',', ':'))
# Encode as Gzip
json_data = gzip.compress(
    json_string.encode('UTF-8'))

req = Request(
    url, headers={"API-TOKEN": "some_token",
                  "Content-Encoding": "gzip"})
response = urlopen(req, json_data)
Reddit bot running in to limit despite setting limit=None

Reddit bot running in to limit despite setting limit=None


By : lebham
Date : March 29 2020, 07:55 AM
hope this fix your issue It seems that it still gets limited if used too much. Waiting for a bit fixed it.
shadow
Privacy Policy - Terms - Contact Us © ourworld-yourmove.org