Mozdev.org

Participants: davidwboswell, (David Boswell), gjm (Gerry Murphy), silfreed (Doug Warner)
Community participants: JesperHansen

Discussion was held publically in #mozdev

Discussed developer priorities

• working on WYSIWYG for Mozdev wiki
• planning on using mediawiki syntax with FCKeditor (noticed DevMo is switching to DekiWiki)
• at ccaygill's prompting (and patch) updated the local.conf documentation
• performed some log analysis of Firefox 3 release traffic
• discussed alternatives to awstats for performing custom stats analysis (no solution found)
• hg was just setup in production; needs tested and then we can open up to projectowners for testing
• once hg is in testing w/ POs I'll be back at working on the wiki and also with new file upload mechanisms

Discussed sysadmin priorities

• some security updates
• mailman upgraded to latest version
• hg setup in production; still needs SSL cert

Web stats/Top 50 page

• stats have caught up
• hits for 2008-06-(17-20) are impressive (FF3 release)

Staging server migration

• mozilla has recently been looking into racking a ton of Mac Minis and OSUOSL just received a shipment of hard drives
• david will ping mozilla again and gjm will get back to OSUOSL

Next meeting July 8th, 2008 @ 15:00 UTC in #mozdev

Semi-busy week with not much to show for it:

• Working on providing a GUI for Mozdev's wiki - For now I think I've settled on using MediaWiki syntax and using FCKeditor. The Drupal module for FCKeditor needs some improvements to support to load different toolbars for different content types (so we can use the mediawiki plugin for wiki pages and the regular toolbar for blogs and other pages). I've submitted a patch that seems to support this, but I'm still working on a way to only load the mediawiki fckeditor plugin only in the wiki profile.
• Documenting more local.conf options
• Performing some log analysis of last week's Firefox release traffic - also discussing alternatives to awstats for performing custom query generation (no solution found yet)

The big thing for this week will be trying to get FCKeditor working with the mediawiki syntax; Independence Day is this Friday for the USA so I'll be offline then.

Participants: gjm (Gerry Murphy), silfreed (Doug Warner)
Community participants: ccaygill

Discussion was held publically in #mozdev

Discussed developer priorities

• finished new bugzilla bug entry form
• helped with Firefox 3 server load (adding additional caches, mostly)
• fixed XPI sorting on project overview page
• working on improving wiki formatting at Mozdev
• investigating integrating Mailman and Drupal Forums
• updated VCS log to include link to a file's history

Discussed sysadmin priorities

• no updates, under the weather
• tanker's out on leave right now; when he get's back they'll work on the OS update on vebzom and then rework the plan for production

Web stats/Top 50 page

• ccaygill has been working on mycroft to reduce hits to old plugins that won't have updates
• munin outages/gaps are related to stats maching blocking on something the stats machine despite it being idle; needs more investigations
• gjm has begun looking at firewall connection table to catch bots and evil users rather than just relying on apache logs

Staging server migration

• no updates

Next meeting July 1st, 2008 @ 15:00 UTC in #mozdev

Getting back into the swing of things after vacation.

• Updating Mozdev bugzilla bug entry form - this is ready to go into production to help making requests to Mozdev easier
• Handling Firefox 3 release server load - the Firefox 3 release caused lots of additional web traffic to mozdev.org in a number of ways; people trying to get news about Firefox 3 (some projects host translations of Mozilla software) and additional update requests for extensions and search plugins caused by lots of people restarting their browsers in a short period of time. I added caching to a number of pages during this time to try to reduce the impact on the server.
• Fixed XPI file sorting on Project Overview page
• Trying to improve wiki formatting at Mozdev - I'm evaluating both using straight HTML for the wiki as well as FCKeditor w/ a mediawiki plugin. I'm leaning towards the latter right now, but the various plugins need some work.
• Investigating linking Mailman and Forums - Currently the plugins require a separate email account to check for new messages and I'm not sure who should be responsible for setting up/maintaining this account (Mozdev or the project owner).
• Updated VCS log to include link to a file's log history

This week I plan to continue working on improving Mozdev's wiki editing capability and look towards how pam_mysql can be configured to allow file uploads at Mozdev.

Participants: davidwboswell (David Boswell), gjm (Gerry Murphy), silfreed (Doug Warner)
Community participants: ccaygill

Discussion was held publically in #mozdev

Discussed developer priorities

• finished up changes to simpler bug entry form
• increased timeout on new Mozdev pages that require login (file managment, project tag editing)
• wrote Mercurial documentation for Mozdev
• Firefox 3 release is today

Discussed sysadmin priorities

• mailman upgrade is in the works; all our custom changes have been included in the new version so we won't be running a hacked version anymore
• looking into using snort for detecting bot attacks on the server; not sure if itwill be feasible or not
• ssl cert w/ multiple domains should be good to install

Web stats/Top 50 page

• still somewhat behind; needs more attention

Staging server migration

• no updates

Adding Drupal/Mailman sync to roadmap

• PO found Drupal modules that should allow integration with Mailman; haven't doneany research yet
• silfreed will look into the integration and we'll update the roadmap if it's more than 1 day's work

Next meeting June 24th, 2008 @ 15:00 UTC in #mozdev

Short week last week due to vacation.

• Working on streamlined Mozdev bug-entry form to help with submitting VCS change requests (and other requests)
• Increased idle timeout on new Mozdev tools
• Writing documentation for requesting and using Mercurial at Mozdev

We're expecting Mercurial to be released soon at Mozdev; we'll be sure to post an update once it's released.Short week last week due to vacation.

Minutes from mozdev sysadmin meeting on Tuesday, June 10, 2008

Participants: davidwboswell (David Boswell), cdn-work (Chris Neale), gjm (Gerry Murphy), silfreed (Doug Warner)
Community participants: ccaygill, JesperHansen

Discussion was held publically in #mozdev

Discussed developer priorities

• added a new mirror for zurich/switzerland
• documented some module settings that caused problems for a PO
• setup an ad system so we can track stats for sponsor buttons
• updated the /source.html vcs log page to support multiple VCSes
• also updated the template /source.html to refer to more VCS types (commmented out)
• updated hgweb to run from mod_python (3x faster, slightly more memory usage)
• created patch for Apache to get hg setup in production
• working on a new bugzilla entry format to help making requests to mozdev easier
• try to finish up the bugzilla form today and that'll be it before I'm off for vacation this week

Discussed sysadmin priorities

• log rotating is updated, but transfers to stats wasn't working properly so top 50 page is still a little behind
• preparing for an OS update to FreeBSD 7; release on the servers is EOL
• tested out eaccelerator again to prepare for ff3 release; still doesn't work with Mozdev code
• mysql backup was tweaked to keep 3 generations instead of one

Web stats/Top 50 page

• currently a little behind, should be catching up

Staging server migration

• no updates

data retention policy

• privacy policy is fairly clear that voluntarily submitted info (ie, to mailing list or newsgroup) is public
• users don't understand/read that and just want their info removed
• current situtation revolves around a person who wants their email to a listremoved w/ no personally identifiable information
• previous instances where we told a user we would not remove an email resulted in angry responses
• in the future we'll try to educate the user about publically posting to lists and move forward if the user is persistent (while trying to avoid censorship by removing the least amount of data possible)

mercurial rollout timeline

• gjm will try to get things setup in production this week
• silfreed will look over things and test out next week when he's back

ssl certs

• the list of domains in bug#19110 should be good to start
• GoDaddy requires that any changes to the cert be a new certificate
• gjm and davidwboswell will work out details for getting a new cert

Next meeting June 17th, 2008 @ 15:00 UTC in #mozdev

• New mirror for Zurich/Switzerland
• Documented Drupal subscription module dependency on comments module (discovered from user problems)
• Setup ad system for tracking stats for sponsor banners
• Updating VCS log page to support multiple VCSes and updating template source.html page to have links for other VCS types.
• Updated hgweb to run from mod_python using a mod_python/wsgi gateway and some tips from the web ([1], [2])
• Creating patch for staging server Apache config - required pruning out a bunch of other staging work for SVN and a new web viewer for SVN and CVS
• Working on new guided entry bugzilla form to help in submitting requests for Mozdev to do things (like ask for a new VCS).

I'm heading to Raystown Lake (PA) tomorrow, so I don't plan to get too much accomplished this week (some more work on the bugzilla guided entry page, most likely).

Participants: davidwboswell (David Boswell), gjm (Gerry Murphy), silfreed (Doug Warner)
Community participants: JesperHansen, djc

Discussion was held publically in #mozdev

Discussed developer priorities

• OSCon/Firefox Summit planning
• Styling hgweb (still needs some work)
• Sponsor work - Songbird page is now live
• new Multi-VCS log RSS feed
• lots of unit test improvements
• updated feedback page to prefer filing bugs for change requests from project owners
• finished setting up ad system for serving sponsor banners to track statistics
• working on updating the /source.html page and testing mod_wsgi

Discussed sysadmin priorities

• additional bot blocking
• mail stopped over the weekend; problem is identified in amavis but still needs worked on
• some bugs processing
• gjm & silfreed are working on ideas for trapping bots

Web stats/Top 50 page

• top 50 should be updating soon
• old logs were inadvertently removed and will need reprocessed

Staging server migration

• David thinks Mozilla might be busy until after firefox 3 is out
• OSUOSL responded that they're still not ready

per-project web stats

• interest from POs?
• davidwboswell thinks the data would be very useful to POs
• will require a lot of time to get through the backlog; not sure if we have enough CPU

Next meeting June 10th, 2008 @ 15:00 UTC in #mozdev

• OSCon/Firefox Summit planning - got my flights booked and applied for my passport
• Styling hgweb - I'm trying to get our hgweb instance styled better but am running into problems modifying Mercurial themes (maps)
• Sponsor work
• New VCS log RSS feed - This one now works with CVS, Mercurial, and eventually SVN
• Lots of unit test improvements for various parts of the Mozdev templating system
• Cleaned up feedback page to recommend project owners file bugs for change requests so we can track problems better

I didn't get nearly as much accomplished last week w.r.t. Mercurial, but we're still making good progress. I need to update the VCS logs that are generated on the /source.html pages and create a new source.html template that includes instructions for mercurial. I also need to write a bunch of docs, but have a fairly good template setup for what needs done.

At mozdev.org we are currently hosting extensions, themes and other add-ons for over 15 different Mozilla-based applications. We are interested in working together with the organizations making these applications to help us with our mission of establishing Mozilla as a viable development platform, helping proliferate Mozilla technologies and increasing the user base of Mozilla-based applications.

We would like to give organizations that are using Mozilla technologies an opportunity to sponsor extensions for their applications that are hosted on mozdev and to find ways to work together to grow their extension developer communities. A few ideas we've had about possible ways to integrate the mozdev community with an application's add-on developer community include:

• Promoting an application's extensions on the mozdev.org home page
• Creating a branded and customized extensions portal (see the just launched Songbird portal for an example of what's possible)
• Subscribing team members to a sponsors group where they can talk to other people working on Mozilla-based applications

Every organization will have their own unique needs, so we are open to any other ideas about how we can help grow the extension developer community around a particular Mozilla-based application. If sponsoring extensions on mozdev is something you'd like to talk more about, please feel free to post here or contact us.

Participating: davidwboswell (David Boswell), ericjung (Eric Jung), gjm (Gerry Murphy), silfreed (Doug Warner)

Discussion was held publically in #mozdev

Discussed developer priorities

• improved bugzilla Mac OS X detection by adding more versions to OS list
• worked with ccaygill of Mycroft to get HTTP header problem fixed that prevented downloads in IE7
• started styling hg web interface; need some help from Mercurial devs to fix some problems w/ themeing
• some more sponsor work
• integrating cvs database logging and hg/svn database logging in various tools
• updated multi-VCS-capable RSS feed should go live today (ex: http://www.vebzom.org/feed/vcslog/)
• OSCon/Summit planning/prep
• found some bugs in both downloads.MD.o and the update.rdf generation that the Brief project ran into; helped them work-around the problem for now and put them on the back-burner
• agenda for this week includes styling the hg web interface and figuring out what can be done about the /source.html for projects that begin using hg
• we should start figuring out how to coordinate the deploy of hg to production; there's going to be a number of steps so it would be good to go over them in advance and work out any problems before we try it
• we should look more into mod_wsgi since the port should be available now; it'll save a lot of CPU compared to running as CGI

Discussed sysadmin priorities

• some bots were active on the site last week; configuration was changed several times to try to prevent them from affecting the site again
• some planning on a better shared-hosting setup
• helping a project troubleshoot their mailing list config

Web stats/Top 50 page

• no stats updating this week; other sysadmin projects are blocking getting it fixed

Staging server migration

• no updates

handling low-level sysadmin tasks

• things like stats processing, cvs cleanup, are time-critical but low-level tasks
• in general, we should figure out how to handle these types of tasks so they don't eat up our sysadmin's time

open feedback requests - cvs management

• gjm will get the server setup so we can have a "cvs admin" and setup silfreed w/ the privs

handling feedback mails

• there's still an open bug for integrating feedback list and bugzilla
• silfreed will join the feedback list to do manual bug filing for sysadmin tasks for now
• update the feedback page to recommend filing bugs for common PO tasks (cvs cleanup, mailing list fixes, etc)

Next meeting June 3rd, 2008 @ 15:00 UTC in #mozdev

Minutes from mozdev sysadmin meeting on Tuesday, May 20, 2008

Present: cdn-work (Chris Neale), ericjung (Eric Jung), gjm (Gerry Murphy), silfreed (Doug Warner)

Discussion was held publically in #mozdev

Discussed developer priorities

• sponsor work
• fixed bugs in update.rdf generation
• documenting move of hg to production
• testing multiple-domain ssl certs - seem to work fine (multiple browsers, hg, svn)
• updated test hgweb to require SSL pushes and added a robots.txt file
• testing new cvs web viewer using viewvc which will also work w/ svn
• plan to spend time this week working on mercurial to get it ready for production

Discussed sysadmin priorities

• ssh updates on stats machine
• used the ssh update opportunity to bring software on stats up to date

Web stats/Top 50 page

• stats started processing this month's logs last night
• top 50 page is back

Staging server migration

• no updates

ccaygill: header Vary: Host issue

• bug#19130
• gjm is behind on bugs; we can implement this soon if necessary, though
• Doug wants to check if this bug affects more than mycroft; will get back to this shortly

Next meeting May 27th, 2008 @ 15:00 UTC in #mozdev

• Work on sponsor pages
• Fixed bugs in update.rdf generation
• Documenting how to move hg to production
• Testing multiple-domain SSL certificates - Found out that certificates with multiple domains (specified in the Subject Alternate Name, SAN field) works with most current browsers, mercurial, and SVN and does not require additional IPs. Setting up a self-signed multiple-domain certificate is a bit tricky and requires using a custom openssl config; the following web pages on generating a multiple-domain CSR and using the openssl config file when generating the key file were useful.
• Enabled SSL cert, restricted non-ssl pushes, and setup a robots.txt file for our test hgweb
• Setting up new cvs web viewer to try to make our "source hosting" link more usable and standardized across our new VCS offerings
• Tested SVN with multiple-domain certificates and viewvc

I didn't end up doing much planning for OSCON or the Firefox Summit last week; it might be difficult to finalize some of those plans since David will be gone this week, but I should at least apply for my Passport.
The sponsor work is mostly complete, so I'm going to refocus on trying to get Mercurial in production. The major tasks for that include integrating the new VCSlog table with other activity checking and rss feeds, styling the hgweb interface (adding mozdev-header, possibly removing some unused features like owner/description), updating our recent CVS/VCS viewer to use the database tables, figuring out how to handle our /source.html pages that all statically reference CVS instructions, and writing documentation for everything. It's mostly a lot of small tasks that together will probably eat up a lot of time.

Present: davidwboswell (David Boswell), ericjung (Eric Jung), gjm (Gerry Murphy), silfreed (Doug Warner)

Discussion was held publically in #mozdev

Discussed developer priorities

• setup mercurial commit logging last week
• upgraded (staging) mercurial to 1.0
• not much other mercurial work accomplished
• updated external links in the mozdev.org header
• released the secure update tool; fixed several minor bugs and updated documentation to make it a little easier to understand
• updated the mozdev.org policy to allow us to fix web errors (and fixed some minor errors for projects I had notified several weeks ago)
• working on updating application list so it can be more easily modified for sponsors
• will be setting up an ad system to track displays, views, clicks, etc for sponsors
• hope to finish up sponsor work by Wednesday, then work on testing SSL certs for Mercurial (and SVN)

Discussed sysadmin priorities

• cleaned up disk space sunday night
• log files have been moved to stats.mozdev.org for archival
• nagios notifications were disabled for drive stats; gjm will check into that

Web stats/Top 50 page

• still processing

Staging server migration

• mozilla said things are still moving for getting a VM there

Next meeting May 20th, 2008 @ 15:00 UTC in #mozdev