From laforge at gnumonks.org Fri Feb 5 16:10:54 2016 From: laforge at gnumonks.org (Harald Welte) Date: Fri, 5 Feb 2016 17:10:54 +0100 Subject: Moving from trac to a single redmine In-Reply-To: <29DF7E51-8366-40A3-8EF1-F4705D3A0E6D@freyther.de> References: <29DF7E51-8366-40A3-8EF1-F4705D3A0E6D@freyther.de> Message-ID: <20160205161054.GE10932@nataraja> Hi Holger, On Thu, Feb 04, 2016 at 08:12:19AM +0100, Holger Freyther wrote: > I think some of us would like to move to redmine and start using > public tickets more frequently. So in case we move there are some > topics to be discussed and I would like to start with a couple of them > right now. Thanks for getting the public discussion about this started. To give some more background to the mailing list: * The trac installations at osmocom.org are pretty much underused/dormant. The only part that's used is the Wiki. * Osmocom started when a single project (OpenBSC) got a sister project (OsmocomBB) and has grown into many projects. Running a single trac instance for each project on a separate dns hostname is overkill. Also, as code is shifted around between libraries and programs, we'd appreciate some flexibility. * at sysmocom internally we have successfully used redmine for dozens of different projects. The project hierarchy can be changed as needed on the fly, and issues can relate to issues of other projects, shifted from project to project, etc. * Quite a bit of the work we do at sysmocom on the Osmocom software should have the issue tracker for bugs and features in the public, but as our internal redmine is so much easier than the public trac setup, we kept using the internal redmine. So my plan moving forward is to migrate all Osmocom projects (initially those related to GSM) to a public redmine, and then keep all issues updated there. This would give more visibility into the work we're doing, such as the EDGE PCU, the 3G NITB + SGSN, the HNB-GW, etc. > Redmine has a global linear sequence of ticket numbers. If we move > from many tracs to a single redmine we can either: > > * not import tickets > * only import from one project > * deal with changing ticket numbers I think not importing tickets or dealing wih changing numbers is the way to go. > In terms of installations the GMR trac is broken in regard to tickets, > there are some for SDR that are probably not being fixed anytime soon, > baseband might be relevant and OpenBSC is unlikely to be relevant. I > don't think we have ever used ticket reference in OpenBSC commit > messages so in terms of OpenBSC having changing ticket numbers would > not be a big deal. E.g. we could add a custom field with the old trac > number? If there is automatic import/conversion available, I'd prefer to import the OsmocomBB, SIMtrace, (non-spam) Security and OpenBSC tickets, even though most of them are probably stale and outdated for years. They're still part of the history. Changing the numbers doesn't matter, as we don't refer to them. > We have external references that should be redirected to the new > place. Is there any way besides maintaining a list in the > apache2/nginx configuration and making redirects as we find broken > references? Can we proactively manage this? Is anybody willing to come > up with a script and nginx configuration for doing this? I'm not aware of any tools that might be able to help here. Indeed, it would be great if anyone would volunteer to generate a script to generate the redirects. I guess the old format is e.g. http://openbsc.osmocom.org/trac/wiki/nanoBTS/Internals and the new URL would be something like http://projects.osmocom.org/redmine/openbsc/wiki/nanoBTS/Internals Or should we strip even the redmine from the URL? And should we have a rewrite for http://openbsc.osmocom.org/redmine to http://projects.osmocom.org/redmine/openbsc ? Any ideas? Regards, Harald -- - Harald Welte http://laforge.gnumonks.org/ ============================================================================ "Privacy in residential applications is a desirable marketing option." (ETSI EN 300 175-7 Ch. A6) From holger at freyther.de Thu Feb 4 07:12:19 2016 From: holger at freyther.de (Holger Freyther) Date: Thu, 4 Feb 2016 08:12:19 +0100 Subject: Moving from trac to a single redmine Message-ID: <29DF7E51-8366-40A3-8EF1-F4705D3A0E6D@freyther.de> Hi guys, I think some of us would like to move to redmine and start using public tickets more frequently. So in case we move there are some topics to be discussed and I would like to start with a couple of them right now. Tickets: Redmine has a global linear sequence of ticket numbers. If we move from many tracs to a single redmine we can either: * not import tickets * only import from one project * deal with changing ticket numbers In terms of installations the GMR trac is broken in regard to tickets, there are some for SDR that are probably not being fixed anytime soon, baseband might be relevant and OpenBSC is unlikely to be relevant. I don't think we have ever used ticket reference in OpenBSC commit messages so in terms of OpenBSC having changing ticket numbers would not be a big deal. E.g. we could add a custom field with the old trac number? Wiki: We have external references that should be redirected to the new place. Is there any way besides maintaining a list in the apache2/nginx configuration and making redirects as we find broken references? Can we proactively manage this? Is anybody willing to come up with a script and nginx configuration for doing this? kind regards holger From 246tnt at gmail.com Fri Feb 5 20:57:12 2016 From: 246tnt at gmail.com (Sylvain Munaut) Date: Fri, 5 Feb 2016 21:57:12 +0100 Subject: Moving from trac to a single redmine In-Reply-To: <20160205161054.GE10932@nataraja> References: <29DF7E51-8366-40A3-8EF1-F4705D3A0E6D@freyther.de> <20160205161054.GE10932@nataraja> Message-ID: Hi, >> I think some of us would like to move to redmine and start using >> public tickets more frequently. So in case we move there are some >> topics to be discussed and I would like to start with a couple of them >> right now. +1 for redmine. >> In terms of installations the GMR trac is broken in regard to tickets, >> there are some for SDR that are probably not being fixed anytime soon, >> baseband might be relevant and OpenBSC is unlikely to be relevant. I >> don't think we have ever used ticket reference in OpenBSC commit >> messages so in terms of OpenBSC having changing ticket numbers would >> not be a big deal. E.g. we could add a custom field with the old trac >> number? > > If there is automatic import/conversion available, I'd prefer to import > the OsmocomBB, SIMtrace, (non-spam) Security and OpenBSC tickets, even > though most of them are probably stale and outdated for years. They're > still part of the history. Changing the numbers doesn't matter, as we > don't refer to them. - OsmocomBB never used tickets AFAIK. - OsmocomGMR definitely never used them - OsmocomSDR ... don't think it's worth importing. - Security ... yeah maybe, although not really sure anyone is really using this. >> We have external references that should be redirected to the new >> place. Is there any way besides maintaining a list in the >> apache2/nginx configuration and making redirects as we find broken >> references? Can we proactively manage this? Is anybody willing to come >> up with a script and nginx configuration for doing this? > > I'm not aware of any tools that might be able to help here. > > Indeed, it would be great if anyone would volunteer to generate a script > to generate the redirects. script ? The page names should be the same, so it should pretty much be just a few redirects per project with regexp to redirect properly. Shouldn't be too hard once we settled for a URL scheme. Any reason not to go for just http://osmocom.org/ as a base ? We have nothing really in the front page and we could just let redmine handle it too. Then just http://osmocom.org/projectname/wiki/page/name looks good to me if doable. Cheers, Sylvain From laforge at gnumonks.org Thu Feb 18 18:43:18 2016 From: laforge at gnumonks.org (Harald Welte) Date: Thu, 18 Feb 2016 19:43:18 +0100 Subject: Moving from trac to a single redmine In-Reply-To: <29DF7E51-8366-40A3-8EF1-F4705D3A0E6D@freyther.de> References: <29DF7E51-8366-40A3-8EF1-F4705D3A0E6D@freyther.de> Message-ID: <20160218184318.GW4570@nataraja> Hi Holger, let's move ahead and start with the migration, I can't wait to put all the various tickets into a public redmine. Thanks! -- - Harald Welte http://laforge.gnumonks.org/ ============================================================================ "Privacy in residential applications is a desirable marketing option." (ETSI EN 300 175-7 Ch. A6) From holger at freyther.de Thu Feb 18 18:52:57 2016 From: holger at freyther.de (Holger Freyther) Date: Thu, 18 Feb 2016 18:52:57 -0000 Subject: Moving from trac to a single redmine In-Reply-To: <20160218184318.GW4570@nataraja> References: <29DF7E51-8366-40A3-8EF1-F4705D3A0E6D@freyther.de> <20160218184318.GW4570@nataraja> Message-ID: <753DCDAF-0723-4EC5-8E3C-870B7D5959C5@freyther.de> > On 18 Feb 2016, at 19:43, Harald Welte wrote: > > Hi Holger, Hi all! > > let's move ahead and start with the migration, I can't wait to put all > the various tickets into a public redmine. last weekend I used the "stock" redmine trac->redmine converter and the result is on projects.osmocom.org. It is not perfect but I think good enough to start moving. We see that certain formating needs a post-import correction but that should be doable by all of us quickly. My plan/timeline (on short notice but I don't expect a major resistence so I hope it is fine): * Patch the redmine importer to not import tickets. This hopefully allows me to import other tracs at the same time (and re-add the security tickets by hand) * Friday evening set the tracs to read-only (I probably move the account file away) * Saturday/Sunday do the migration of the trac. * Make it available on osmocom.org (currently it is projects.osmocom.org) * Keep the trac as read-only version for now In the mid-term: * We need to post-process some pages and move them around to have a better structure * Add permanent redirects from the trac to osmocom.org for "approved" content. This way normal traffic will automatically move to the new page and then we can look at the access.log for which pages still need a re-direct. any objections? holger From nhofmeyr at sysmocom.de Thu Feb 18 23:30:00 2016 From: nhofmeyr at sysmocom.de (Neels Hofmeyr) Date: Thu, 18 Feb 2016 23:30:00 -0000 Subject: Moving from trac to a single redmine In-Reply-To: <753DCDAF-0723-4EC5-8E3C-870B7D5959C5@freyther.de> References: <29DF7E51-8366-40A3-8EF1-F4705D3A0E6D@freyther.de> <20160218184318.GW4570@nataraja> <753DCDAF-0723-4EC5-8E3C-870B7D5959C5@freyther.de> Message-ID: <20160218231601.GC18542@dub6> On Thu, Feb 18, 2016 at 07:52:55PM +0100, Holger Freyther wrote: > last weekend I used the "stock" redmine trac->redmine converter and the result is on projects.osmocom.org. It is not perfect but I think good enough to start moving. We see that certain formating needs a post-import correction but that should be doable by all of us quickly. I swiftly registered a 'neels' account and as soon as it's granted project memberships, I'd start off by making the overview png visible inline on the OpenBSC wiki page (unless we can automate those somehow). nitpick: I notice that in redmine, the project name "Openbsc" should probably be capitalized ("OpenBSC")? > * Saturday/Sunday do the migration of the trac. was I too quick then? I'll recreate my account again if necessary. > any objections? no problem, since we're all idling around all the time anyway ;) More seriously though, the wiki is on my todo list to explain gtphub and adjust that overview png, also to include Iu. Some day not too far I hope... ~Neels -- - Neels Hofmeyr http://www.sysmocom.de/ ======================================================================= * sysmocom - systems for mobile communications GmbH * Alt-Moabit 93 * 10559 Berlin, Germany * Sitz / Registered office: Berlin, HRB 134158 B * Gesch?ftsf?hrer / Managing Directors: Holger Freyther, Harald Welte -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: Digital signature URL: From holger at freyther.de Fri Feb 19 07:10:05 2016 From: holger at freyther.de (Holger Freyther) Date: Fri, 19 Feb 2016 07:10:05 -0000 Subject: Moving from trac to a single redmine In-Reply-To: <20160218231601.GC18542@dub6> References: <29DF7E51-8366-40A3-8EF1-F4705D3A0E6D@freyther.de> <20160218184318.GW4570@nataraja> <753DCDAF-0723-4EC5-8E3C-870B7D5959C5@freyther.de> <20160218231601.GC18542@dub6> Message-ID: > On 19 Feb 2016, at 00:16, Neels Hofmeyr wrote: > > > nitpick: I notice that in redmine, the project name "Openbsc" should > probably be capitalized ("OpenBSC")? The redmine importer insists only works if I enter "openbsc" and then it apparently does "Openbsc" with it. But we can fix that after the import. >> * Saturday/Sunday do the migration of the trac. > > was I too quick then? I'll recreate my account again if necessary. I think we do not need to remove accounts. We might have to fix the email address of contributors that got their account automatically created as part of the import. > >> any objections? > > no problem, since we're all idling around all the time anyway ;) > More seriously though, the wiki is on my todo list to explain gtphub and > adjust that overview png, also to include Iu. Some day not too far I hope... The wiki conversion is not that great. We really have to do some work in post processing and making sure that all content has been migrated. E.g. "Software/Overview" and "SoftwareOverview" seem to confuse the importer: http://projects.osmocom.org/projects/baseband/wiki/SoftwareOverview vs. http://bb.osmocom.org/trac/wiki/Software/Overview vs. http://bb.osmocom.org/trac/wiki/SoftwareOverview So there will be some fallout but I think it still makes sense to move forward now. holger From holger at freyther.de Fri Feb 19 20:00:43 2016 From: holger at freyther.de (Holger Freyther) Date: Fri, 19 Feb 2016 20:00:43 -0000 Subject: Moving from trac to a single redmine In-Reply-To: References: <29DF7E51-8366-40A3-8EF1-F4705D3A0E6D@freyther.de> <20160218184318.GW4570@nataraja> <753DCDAF-0723-4EC5-8E3C-870B7D5959C5@freyther.de> <20160218231601.GC18542@dub6> Message-ID: > On 19 Feb 2016, at 08:09, Holger Freyther wrote: > > > The wiki conversion is not that great. We really have to do some work in post processing and making sure that all content has been migrated. E.g. "Software/Overview" and "SoftwareOverview" seem to confuse the importer: > > http://projects.osmocom.org/projects/baseband/wiki/SoftwareOverview vs. http://bb.osmocom.org/trac/wiki/Software/Overview vs. http://bb.osmocom.org/trac/wiki/SoftwareOverview I am fixing this but if somebody wants to help with some code/regexp it would be nice too. In trac we have: [[Image(motorola_filter_replacement_step_1_low.jpg, 250px)]] For redmine we need: {{thumbnail(motorola_filter_replacement_step_1_low.jpg, size=250)}} Anyone wants to try his luck with a regexp to do this automatically? Or a bit of ruby code to split and manipulate if it is matching [[Image? From elofssonjens at gmail.com Fri Feb 19 22:01:34 2016 From: elofssonjens at gmail.com (Jens Elofsson) Date: Fri, 19 Feb 2016 22:01:34 -0000 Subject: Moving from trac to a single redmine In-Reply-To: References: <29DF7E51-8366-40A3-8EF1-F4705D3A0E6D@freyther.de> <20160218184318.GW4570@nataraja> <753DCDAF-0723-4EC5-8E3C-870B7D5959C5@freyther.de> <20160218231601.GC18542@dub6> Message-ID: According to Google, this should do the trick perl -p -i -e 's/\[\[Image\((.+?)\)\]\]/\{\{thumbnail\($1\)\}\}/g' filename.txt (note that it replaces [[Image...]] with {{thumbnail...}} in the file without creating a backup)). /Jens E 2016-02-19 21:00 GMT+01:00 Holger Freyther : > > > On 19 Feb 2016, at 08:09, Holger Freyther wrote: > > > > > > The wiki conversion is not that great. We really have to do some work in > post processing and making sure that all content has been migrated. E.g. > "Software/Overview" and "SoftwareOverview" seem to confuse the importer: > > > > http://projects.osmocom.org/projects/baseband/wiki/SoftwareOverview vs. > http://bb.osmocom.org/trac/wiki/Software/Overview vs. > http://bb.osmocom.org/trac/wiki/SoftwareOverview > > I am fixing this but if somebody wants to help with some code/regexp it > would be nice too. > > In trac we have: > > [[Image(motorola_filter_replacement_step_1_low.jpg, 250px)]] > > For redmine we need: > > {{thumbnail(motorola_filter_replacement_step_1_low.jpg, size=250)}} > > Anyone wants to try his luck with a regexp to do this automatically? Or a > bit of ruby code to split and manipulate if it is matching [[Image? > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From holger at freyther.de Sat Feb 20 10:58:12 2016 From: holger at freyther.de (Holger Freyther) Date: Sat, 20 Feb 2016 10:58:12 -0000 Subject: Progress of trac->redmine migration Message-ID: <7BA392B9-A3E6-41E6-98ED-10F7F4B699DD@freyther.de> Hi all, I think we are close to the point of no return. All tickets and wikis have been imported. Please have a quick look if there is something obviously broken and if not I will proceed with post-processing and renaming tonight. kind regards holger