SyntaxBomb - Indie Coders

General Category => General Discussion => Topic started by: Qube on June 20, 2017, 00:12:24

Title: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on June 20, 2017, 00:12:24
Great news!!!

I've had written permission from Simon ( Skidracer ) to mirror the Code Archives from BB to here ;D

I have to whip up an app to convert and plonk the relevant info into our DB but it shouldn't be too much of a chore to do. I'll test in an offline location to make sure my code doesn't screw up all the forums  :P
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: GW on June 20, 2017, 01:56:41
Cool,
Are you going to host them here in a way that they keep their structure and we can add to them over time?

Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on June 20, 2017, 02:35:08
Quote from: GW on June 20, 2017, 01:56:41
Cool,
Are you going to host them here in a way that they keep their structure and we can add to them over time?
The archives will be integrated into these forums directly which means that members can add new ones and also comment on the old ones.
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Rooster on June 20, 2017, 03:15:02
Sounds good.
There's at least one thing I was planing to use from there.
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: LineOf7s on June 20, 2017, 04:24:39
That is excellent news.  Well done.  Quite a coup.
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: GW on June 20, 2017, 05:10:44
Qube's looking for that top-poster money by adding 500 new topics at once...
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: MikeHart on June 20, 2017, 05:26:31
The code archive is PD so there is no permission needed to bring it anywhere.
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on June 20, 2017, 06:08:29
QuoteQube's looking for that top-poster money by adding 500 new topics at once...
I'm still exempt from that :P

QuoteThe code archive is PD so there is no permission needed to bring it anywhere.
This may be true for the actual code marked as public domain but I wanted permission for the comments / contributions that were made by members in the same threads. Plus I'll be using the same layout and referencing the original authors and commenters and posts will be in the same order as on the BB forums.

This is why I asked Simon for permission to mirror the code archives as they will reflect in a very similar manner to what they were on the BB forums. I'd rather not have to fire money in my business lawyers direction if I can help it for stepping on anyones toes ( sorry Michael but your charges are worse than mine :P ).
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: MikeHart on June 20, 2017, 06:42:48
No problem Qube. I didn't  know that the comments are not PD only the initial post is.


Charges? Guess you know more again. Please enlight me.
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on June 20, 2017, 07:14:26
QuoteCharges? Guess you know more again. Please enlight me.
There are no charges :) - I was just saying that if I went ahead and copied the BB code archives then I may get a letter from BRL's solicitors which means I have to ask Michael ( my solicitor ) to deal with it. As he charges per breath I'd rather take the nicer approach and simply ask permission. Thankfully, Simon said that is fine which is good of him and good for us all :D
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: MikeHart on June 20, 2017, 07:59:48
Ah ok.  :D
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: therevills on June 20, 2017, 10:41:18
Great News Everyone :)

(https://www.syntaxbomb.com/proxy.php?request=http%3A%2F%2Fvignette2.wikia.nocookie.net%2Fen.futurama%2Fimages%2Fa%2Fad%2FGoodNewsEveryone.jpg&hash=3e494577e92a52e13c9e76dc788748179ccb8768)
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Steve Elliott on June 20, 2017, 11:00:57
Quote
That is excellent news.  Well done.  Quite a coup.

Certainly is, onwards and upwards Syntaxbomb!
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: degac on June 20, 2017, 11:42:24
Quick question:
Skid already released (.zip package) both code-archive and image gallery.
IIRC code-archive were PD (there was a message/checkout when you updloaded a source code).

So - technically - they are 'free' without needs of permission of author or BRL

I'm talking about the 'code-archive' (source code) not of course of comments.

Btw, I was toying around to make an online version.. but at this point I will stop my efforts to see your results!
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: EdzUp on June 20, 2017, 16:33:09
Amazing stuff will convert some of my stuff to other platforms :)
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Rick Nasher on June 20, 2017, 22:54:15
That's wonderful. All in same structure is a real good thing.
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on June 21, 2017, 23:26:04
Just to update, this is still going to happen soon soon. I've just been bogged down with real life coding work :(
Title: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Mikey on June 25, 2017, 03:09:55
This is really a great thing

I was new to the site, using them as a source and then, gone.

But now Great!!!!!!!!!!

Cannot wait
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on June 28, 2017, 06:55:57
Update : I've have done the code for conversion and forum insertion but there are a handful of irregularities to code around. These should be done today and when ready to insert into the the forum I'll put it into maintenance mode to avoid any issues with MySQL ID's. As the script will be pushing probably 50+ posts a second I think it's best that it has sole priority on it's job.

I estimate that the forums will be unavailable for approx 30 minutes tops for pre and post work. I will take a full database backup beforehand just incase some anomaly wreaks havoc with the forums.
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Rick Nasher on June 28, 2017, 19:31:16
Fingers X-ed!
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on June 29, 2017, 00:40:01
Blitz Code Archives are up :D

There may be a couple of errors here and there and I know they need reordering ( date issues ). But, they are in :P
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: GW on June 29, 2017, 06:03:53
Looks good!

can I pose 2 suggestions?
1) remove the period from [.bmx] and [.bb]
2) change the '&amp;lt;' into '<'
3) any way to show more posts per page?
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: degac on June 29, 2017, 07:20:41
Thanks for putting online the code-archive & comments!

Quick note:
1. if you click (as user) UNREAD (post) you will have something like +150 page to read! (can you make it as 'read' for everyone)?
2. it seems that the archive is 'inside' the forum... good for posting comments, dont' know if so good for searching

Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on June 29, 2017, 11:32:37
Quote1) remove the period from [.bmx] and [.bb]
Done.
Quote2) change the '&amp;lt;' into '<'
Fixed.
Quote3) any way to show more posts per page?
Only for forum wide and not by board.

Quote1. if you click (as user) UNREAD (post) you will have something like +150 page to read! (can you make it as 'read' for everyone)?
Quickest way is to go into your unread posts, scroll to the bottom and click on "mark all as read"
Quote2. it seems that the archive is 'inside' the forum... good for posting comments, dont' know if so good for searching
Search works fine?
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Steve Elliott on June 30, 2017, 18:54:44
Ooo Blitz Code Archives have appeared.  This place suddenly got a whole lot more substantial.  Nice one Qube.
Title: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Mikey on July 01, 2017, 02:52:00
Thanks for the BB code archives.

Wonderful Job
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Kryzon on July 01, 2017, 10:07:46
Thank you for bringing them here.

There's also the domain set up by skidracer (I think?), it preserves the categories:
http://wasted.nz/codearcs.php

- - - - -
Ehh...thinking about it, why couldn't those forums just have moved to wasted.nz instead of being taken down entirely? It wouldn't be related to BRL anymore, like intended.
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: RonTek on July 01, 2017, 10:27:57
Nice!
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: GW on July 01, 2017, 18:29:06
Quote from: Kryzon on July 01, 2017, 10:07:46
Ehh...thinking about it, why couldn't those forums just have moved to wasted.nz instead of being taken down entirely? It wouldn't be related to BRL anymore, like intended.

The goal was to burn down the old communities in hopes that everyone would move over to monkey2 which is currently a ghost-town.
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: GW on July 02, 2017, 00:24:16
btw: There are still are a lot of '&quot;' in the code archives.
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on July 02, 2017, 00:37:54
Quote from: GW on July 02, 2017, 00:24:16
btw: There are still are a lot of '&quot;' in the code archives.
There are? God damn MySQL!

Could you post a couple of links here please so I can see what I missed last time and fixy fix fix
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: GW on July 02, 2017, 00:54:21
I shouldn't say there's a lot, it looks like just a few posts have them..

Here's one
http://www.syntaxbomb.com/index.php/topic,2902.msg3891.html (http://www.syntaxbomb.com/index.php/topic,2902.msg3891.html)

I've also found several archive posts that have no content at all
http://www.syntaxbomb.com/index.php/topic,706.msg1695.html#msg1695
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on July 02, 2017, 01:09:28
Oh I see, thanks. That should be easily sorted via the joys of SQL. I'll do that later today on a mass search and replace to correct other entries too.

QuoteI've also found several archive posts that have no content at all
Funnily enough I spotted a couple today. I need to find out why that happened and if it's only a couple I'll manually add them in but if there are loads then I'll see if my code got confused or if the forum just spat the SQL back out again.


Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: xlsior on July 02, 2017, 21:37:45
Just noticed another problem, looking at one of my old postings:

http://www.syntaxbomb.com/index.php/topic,2973.0.html

instead of & it shows &amp; in the source.

Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on July 02, 2017, 23:03:57
&quot; instead of "
fixed all 130+ instances

&amp; instead of &
fixed all 500+ instances
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Krischan on July 03, 2017, 07:59:13
I noticed that the remote image links are messed and additional code tags in the comments section are not being parsed, see http://www.syntaxbomb.com/index.php/topic,3176.msg4165.html#msg4165 (http://www.syntaxbomb.com/index.php/topic,3176.msg4165.html#msg4165) for example.

The URL is in plain text <img src="../../blitzbasic.christianhart.de/bb/elite/elitescanner.png"> but should be blitzbasic.christianhart.de/bb/elite/elitescanner.png only, or with a http:// prefix.

(https://www.syntaxbomb.com/proxy.php?request=http%3A%2F%2Fblitzbasic.christianhart.de%2Fbb%2Felite%2Felitescanner.png&hash=8e0b0c7159aa832a2f0693d4ba42d57a07235bd3)
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on July 03, 2017, 16:05:45
QuoteThe URL is in plain text
Fixed for all <img src=""> tags :)
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Krischan on July 03, 2017, 21:08:39
Hmm ok, perhaps you have time to take a look at more nasty bugs, see attached images? :o

bug_empty: The post contains nothing, even if the post is older
bug_imagelinebreak: the image should start a new paragraph and shoudl be displayed instead of the link
bug_opentags: there is an open italics tag left
bug_url1: could be the same problem like bug_opentags, looks messed
bug_url2: the reference looks strange, and could the same bug like the two previous bugs

Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on July 04, 2017, 02:58:09
Quote from: Krischan on July 03, 2017, 21:08:39
Hmm ok, perhaps you have time to take a look at more nasty bugs, see attached images? :o

Time?. This isn't the time to argue about time, we don't have the time...

There are a few more HTML elements in the archives than I thought. When I first looked at a handful of entries they were pretty much all the same pattern. I coded the importer based on those. Sods law there were more.

Luckily it's nothing drastic and for a majority you can do a blanket find / replace to sort the issue. For the <a href> posts I'll have to do a tiny bit of coding to strip the double URL's and make it one URL wrapped in BB code.

Thanks for creating more work for me :P
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: RonTek on July 04, 2017, 05:04:20
The forum version looks nice and integrated, but I think it would be much easier and more convenient to just get the static copy of the archives and query it the same way as the original archives, then modify the theme a bit to match with the site. I have seen there are additional comments and info that provides fixes or updates on most resources.

http://blitzbasic.com/codearcs.php?cat=13 Categories
http://blitzbasic.com/codearcs.php?code=3307 Resource
http://blitzbasic.com/codearcs.php?cat=13&order=&asc=&lang_id=2 Categories with Language Type (BB/BMX/ALL)

Here's a screenshot of the quick styling that I did using the wasted.nz archive copy..

(https://www.syntaxbomb.com/proxy.php?request=http%3A%2F%2Fi.imgur.com%2FGcw9zaf.png&hash=cd104dfa977f50aa70b4ae7b0c7588f92188dddc)


Full Page

http://i.imgur.com/745VGzz.jpg



Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on July 04, 2017, 11:21:15
Quote from: RonTek on July 04, 2017, 05:04:20
The forum version looks nice and integrated, but I think it would be much easier and more convenient to just get the static copy of the archives and query it the same way as the original archives, then modify the theme a bit to match with the site. I have seen there are additional comments and info that provides fixes or updates on most resources.

I was not provided with the MySQL DB for the code archives or else it would of been much easier. All I had to work with was static HTML pages. So I can't just add a static copy and make it queryable via the forums, hence integrating them into the forums. Also I want the code archives as part of Syntaxbomb so they can be added to over time.

There's only a couple of niggles to solve :)
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: RonTek on July 04, 2017, 12:35:50
Ah got it. Actually, though it may take time but it's not that hard to pull url queries or content particularly if you have a few fields to deal with. For the code archives I'm seeing only 3: the item id, category and language type. Even without an existing MySQL db, you can still rebuild the archives with MySQL as long as the reference links are consistent and intact.

Well, hope all works ok. :)

Btw, I was wondering why you still need to get permission if the code is licensed as Public Domain..

QuoteThis code has been declared by its author to be Public Domain code.

I would assume the permission includes the whole page or user comments/replies and other content like images?

Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on July 04, 2017, 16:33:21
Quoteyou can still rebuild the archives with MySQL as long as the reference links are consistent and intact.
All the HTML pages are converted into the DB here. There are just a few issues to solve with in post links. They'll be sorted :)

QuoteBtw, I was wondering why you still need to get permission if the code is licensed as Public Domain..
I wanted to include the comments with original post. While the code is public domain, the comments are not. As I've mirrored 1000's of posts it was far easier to ask permission. Simples :D
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: xlsior on July 04, 2017, 21:33:50
It looks like it still shows &amp; instead of & in the post titles, e.g.:

https://www.syntaxbomb.com/index.php?topic=2845.0
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on July 04, 2017, 22:04:26
Quote from: xlsior on July 04, 2017, 21:33:50
It looks like it still shows &amp; instead of & in the post titles, e.g.:

https://www.syntaxbomb.com/index.php?topic=2845.0

I only applied the changes to the body of the post. I didn't think the issue would be in the titles too. Will sort out this evening, thanks.
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Krischan on July 04, 2017, 23:44:11
Quote from: Qube on July 04, 2017, 02:58:09Thanks for creating more work for me :P
You're welcome ;D What about the empty code archive posts like this (http://www.syntaxbomb.com/index.php/topic,3037.msg4026.html#msg4026) or this (http://www.syntaxbomb.com/index.php/topic,1177.msg2166.html#msg2166)?
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on July 05, 2017, 00:09:08
Quote from: Krischan on July 04, 2017, 23:44:11
What about the empty code archive posts like this (http://www.syntaxbomb.com/index.php/topic,3037.msg4026.html#msg4026) or this (http://www.syntaxbomb.com/index.php/topic,1177.msg2166.html#msg2166)?

I've had a very quick speedy look at what caused the empty ones but nothing sprang out immediately. It'll more likely be a simple tag that's not present in the other posts.

Once I've sorted out all the remaining glitches I'll do the empty posts :) ( slowly goes it due to real life shenanigans )
Title: Re: BlitzBasic Code Archives coming to SyntaxBomb
Post by: Qube on July 05, 2017, 03:01:51
Quote from: xlsior on July 04, 2017, 21:33:50
It looks like it still shows &amp; instead of & in the post titles, e.g.:

https://www.syntaxbomb.com/index.php?topic=2845.0
All 36 instances of that issue fixed :)