Page 1 of 1

Hello?

Posted: Mon Jun 21, 2021 3:52 pm
by MadWorld
Test submission.

This snapshot shows that the last known comment from Voat.xyz was from 2 hours ago; yet there are comments newer than 2 hours. You can check that in Voat.xyz's bump section for newer comments. Are newer comments of older submissions fetched from the site as well?

With only voat.xyz search option on, the submission from SearchVoat forum also appeared in the result. It was a submission; yet, it was included in the comments search.

@SearchVoat

While trying to submit this report to SubsAndMods, I also got the following error:
Fatal error: Uncaught Twig\Error\LoaderError: There are no registered paths for namespace "zukero_usernamebbcode". in /home/public/vendor/twig/twig/src/Loader/FilesystemLoader.php:227 Stack trace: #0 /home/public/phpbb/template/twig/loader.php(135): Twig\Loader\FilesystemLoader->findTemplate('zukero_usernam...', true) #1 /home/public/vendor/twig/twig/src/Loader/FilesystemLoader.php(150): phpbb\template\twig\loader->findTemplate('zukero_usernam...') #2 /home/public/vendor/twig/twig/src/Environment.php(299): Twig\Loader\FilesystemLoader->getCacheKey('zukero_usernam...') #3 /home/public/vendor/twig/twig/src/Environment.php(381): Twig\Environment->getTemplateClass('zukero_usernam...') #4 /home/public/phpbb/template/twig/environment.php(292): Twig\Environment->loadTemplate('zukero_usernam...', NULL) #5 /home/public/vendor/twig/twig/src/Environment.php(359): phpbb\template\twig\environment->loadTemplate('zukero_usernam...') #6 /home/public/vendor/twig/twig/src/Environment.php(318): Twig\Environment->load('zukero_usernam. in /home/public/vendor/twig/twig/src/Loader/FilesystemLoader.php on line 227

Re: Hello?

Posted: Mon Jun 21, 2021 3:57 pm
by MadWorld
Weird, it is now shown as submitted on SVF.

Re: Hello?

Posted: Mon Jun 21, 2021 4:44 pm
by shewhomustbeobeyed
I noticed that SV seems to wait for a period of time, before listing a post. Maybe an hour or two? might be the same with 'comments'.
You broke subsandmods? Good job!

Re: Hello?

Posted: Mon Jun 21, 2021 7:20 pm
by SearchVoat
This only needed to be posted once.

On it, might be a few hours...

Re: Hello?

Posted: Mon Jun 21, 2021 7:38 pm
by MadWorld
shewhomustbeobeyed wrote: Mon Jun 21, 2021 4:44 pm I noticed that SV seems to wait for a period of time, before listing a post. Maybe an hour or two? might be the same with 'comments'.
You broke subsandmods? Good job!
The search result appeared to remain that way. I just did a search and it appeared that @SearchVoat got the data, but did not necessarily list the comments. The comments seemed searchable (example). However, not all of them. For example, search this 3-day old comment
https://www.voat.xyz/viewpost.php?posti ... cba99d0f60
[ - ] WWV2WVA [op] 0 points 3 days ago (+0/-0)

It is back XD
and got nothing. I am guessing that something got stuck in the process.

Re: Hello?

Posted: Mon Jun 21, 2021 7:40 pm
by MadWorld
SearchVoat wrote: Mon Jun 21, 2021 7:20 pm This only needed to be posted once.

On it, might be a few hours...
It gave me error, so I thought I could try again. And then all submissions/comments went through before I realized it. Sorry.

Re: Hello?

Posted: Mon Jun 21, 2021 8:27 pm
by shewhomustbeobeyed
MadWorld wrote: Mon Jun 21, 2021 7:38 pm
shewhomustbeobeyed wrote: Mon Jun 21, 2021 4:44 pm I noticed that SV seems to wait for a period of time, before listing a post. Maybe an hour or two? might be the same with 'comments'.
You broke subsandmods? Good job!
The search result appeared to remain that way. I just did a search and it appeared that @SearchVoat got the data, but did not necessarily list the comments. The comments seemed searchable (example). However, not all of them. For example, search this 3-day old comment
https://www.voat.xyz/viewpost.php?posti ... cba99d0f60
[ - ] WWV2WVA [op] 0 points 3 days ago (+0/-0)

It is back XD
and got nothing. I am guessing that something got stuck in the process.
I didn't know xyz comments made it to searchvoat. I thought it was just the main posts.
I sure am glad I'm not the only one who makes extra work for SearchVoat! Poor guy. :D

Re: Hello?

Posted: Tue Jun 22, 2021 1:03 am
by SearchVoat
MadWorld wrote: Mon Jun 21, 2021 7:38 pm For example, search this 3-day old comment
https://www.voat.xyz/viewpost.php?posti ... cba99d0f60
[ - ] WWV2WVA [op] 0 points 3 days ago (+0/-0)

It is back XD
and got nothing.
Yep that comment is missing in my database. I don't have a reliable way of fetching posts and comments from .xyz, I just scrape. I try to keep track of the "number of comments" field on the list of posts, but often it is incorrect, so I never get around to scraping some post pages (i.e. the comments).

I guess @The_Venerable and I should collaborate on improving this...

Re: Hello?

Posted: Tue Jun 22, 2021 3:16 am
by MadWorld
SearchVoat wrote: Tue Jun 22, 2021 1:03 am Yep that comment is missing in my database. I don't have a reliable way of fetching posts and comments from .xyz, I just scrape. I try to keep track of the "number of comments" field on the list of posts, but often it is incorrect, so I never get around to scraping some post pages (i.e. the comments).

I guess @The_Venerable and I should collaborate on improving this...
I think there should be API created just for this purpose. You should not have to resort to scraping. You should also be given the exact timestamp of submissions and comments, which will be helpful for users who may be using it to establish a timeline of some sort.