Difference between revisions of "User:Stattrav/GSoC2012 log"

From BRL-CAD
m (Updation of the logs.)
m
 
(26 intermediate revisions by the same user not shown)
Line 1: Line 1:
−
===5 Jun 2012===
+
===22 August 2012===
−
* Understood the extensions framework of mediawiki and API framework and interfaces via the special pages.
+
* Tried running the bottle app on multi-threaded and asynchronous servers. Tested out Tornado. Currently running on python-paste
−
* API file upload still did not work locally. Still figuring it out because of some authentication token related issues
 
−
* Laid out the skeletal structure for the extension
 
  
−
===4 Jun 2012===
+
===20 August 2012===
−
* Started writing the mediawiki extension. Mediawiki extension tutorials are extremely vague and it is taking me some time to sink in the necessary details.
+
* Documentation
  
−
===1 Jun 2012===
+
===17-19 August 2012===
−
* Wrote a logger for the existing code plus a bit of sanity check and cleanup for the already existing code.
+
* Rolled out the crude website which is hosted at http://88.198.223.105:8080/
−
* Was reading up the API documentation of mediawiki, its file upload [http://www.mediawiki.org/wiki/API:Upload| via API] and [http://www.mediawiki.org/wiki/API:Calling_internally| calling API from an extension]
+
* Upload page working on the localhost but buggy on the VPS
 +
* Documentation
 +
* Full of bugs, project immature
  
−
===30 May 2012===
+
=== 15-16 August 2012 ===
−
* Rewrote the parser as the old was monolithic scraper. Implemented the Parser class and some sub routines. Submitted two patches. [https://sourceforge.net/tracker/?func=detail&aid=3530951&group_id=105292&atid=640804| Patch1] [https://sourceforge.net/tracker/?func=detail&aid=3530950&group_id=105292&atid=640804| Patch2]
+
* Added views for the plots and configured the output to be presented via the template in the view
−
* Results of the scraping are as follows.  
+
* Made changes to existing folder structure for the Bottle app to run
−
[[Image:Benchmark_perfomance_db.png|800px]]
+
* Configured and made a run_server.py script
−
* Code layout has been changed:
+
* Source is at https://bitbucket.org/suryajith/benchmark/src
−
  svnroot/brlcad/web/trunk/benchmark
+
* Awaiting Dr.Rai's perusal of the patches.
−
                                    |- config
+
[[Image:absavgperfvsimagescomb.png|900px]]
−
                                    |_ libs
+
[[Image:absavgperfvsimages2.png|900px]]
−
                                          |_ parser.py
+
[[Image:absavgperfvsimages1.png|900px]]
−
                                          |_ util.py
+
[[Image:absavgperfvsarchpermhz.png|900px]]
−
                                    |_ scripts
+
[[Image:absavgperfvsarch.png|900px]]
−
                                              |_ parse.py
 
−
                                    |_ sql
 
−
                                          |_ benchmark_db.sql
 
−
* config file layout is as follows :
 
−
[database]
 
−
host = localhost
 
−
username = <user>
 
−
password = <pass>
 
−
database = benchmark_db
 
  
−
[locations]
 
−
archive = ./archive
 
−
benchmark_root = path/to/trunk/htdocs/benchmark/
 
  
−
===28 May 2012===
+
===12-14 August 2012===
−
* The data is now pushed into the db. Takes the settings from a config file situated in the root of the benchmark source.
+
* Necessary changes in the db structure for the data needed for graphs
−
* Cleaning the script and testing with the data. I shall send in a formal mail discussing the script execution and usage which presents the work I've done.
+
* Necessary changes to the Parser script
 +
* Implemented
 +
** Absolute Performance vs Reference images over various architectures
 +
** Average Performance vs Architectures
 +
** Average Performance per CPU MHz vs Architectures
 +
** Absolute Performance vs CPU over various architectures
 +
** Absolute Performance vs CPU over various images for specific architecture
 +
* Forms for comparision between various architectures
 +
* Three modes of data displayed : text, table, graph
 +
* Below are some examples of the graphs generated from the data in the database
 +
[[Image:Perfvsimages.png|900px]]
 +
[[Image:absavgperfpermhz.png|900px]]
 +
[[Image:Absavgperf.png|900px]]
  
−
===27 May 2012===
+
===8-11 August 2012===
−
* Made the code completely based on the regexes as per the syntax in the bench/run.sh file.
+
* MVC framework using bottle
 +
* Developed controllers for upload and basic charting libraries
 +
* Charting libraries : Wrapper over the GCharts by generating and thus embedding the js code
  
−
===24 May 2012===
+
===1-6 August 2012===
−
* Crude script for the parser and to transfer the data to the db.
+
* More failed attempts at working with mediawiki
  
−
===22 May 2012===
+
===28-29 July 2012===
−
* Made progress with the parser.  
+
* Implemented a custom form renderer.
−
* Code layout in terms of the folders was decided upon and is as follows:
+
* Results to be integrated.
−
  svnroot/brlcad/web/trunk/benchmark
 
−
                                    |_ scripts
 
−
                                              |_ parser.py
 
−
                                    |_ sql
 
−
                                          |_ benchmark_db.sql
 
  
−
===21 May 2012===
+
===21 July 2012===
−
* Completed the [http://sourceforge.net/tracker/?func=detail&aid=3528693&group_id=105292&atid=640804| patch] for the bench/pixcmp.c. Preliminary testing done. Benchmark script executes without fail. Waiting for Sean to approve and say if that is what is really wanted.
+
* Realized that simpleforms do not help much and have begun writing the forms natively in PHP.
−
brlcad-build → bin/pixcmp -d4 ../brlcad/pix/moss.pix ../brlcad/pix/moss_new.pix
 
−
pixcmp pixels: 262140 matching, 4 off by 4, 0 off by many
 
  
−
brlcad-build → bin/pixcmp -d2 ../brlcad/pix/moss.pix ../brlcad/pix/moss.pix
+
===20 July 2012===
−
pixcmp pixels: 262144 matching, 0 off by 2, 0 off by many
+
* Still figuring out the forms and the implementation of the actions
  
−
brlcad-build → bin/pixcmp -d2 ../brlcad/pix/moss.pix ../brlcad/pix/moss_new.pix
+
===17-18 July 2012===
−
pixcmp pixels: 262140 matching, 4 off by 2, 0 off by many
+
* Playing around with the Simple forms extension. Naive html forms wouldn't help as the action can't be hard coded.  
 +
* It has some issues with mediawiki 1.20(alpha) due to some deprecations in the mediawiki codebase but figured out a few of them.
  
−
brlcad-build → bin/pixcmp -d1 ../brlcad/pix/moss.pix ../brlcad/pix/moss_new.pix
 
−
pixcmp pixels: 262140 matching, 2 off by 1, 2 off by many
 
  
−
brlcad-build → bin/pixcmp ../brlcad/pix/moss.pix ../brlcad/pix/moss_new.pix
+
===11-12 July 2012===
−
pixcmp pixels: 262140 matching, 2 off by 1, 2 off by many 
+
* Upload form on the special page.
 +
* Read up on Google charts embedding. Thoughts on the features required for the frontend.
  
−
* Started writing the log parser.
+
===9-10 July 2012===
 +
* Documentation and fixing the flow. logging cleanup.
 +
* Frontend
  
−
===18 May 2012===
+
===5 July 2012===
−
* Started looking into the issue which Sean mentioned which is related to pixcmp and found nothing there. Sean later found out that the bug was in the pixdiff utilty.
+
* Read up the forms implementation for the frontend of mediawiki extension
−
* Amidst this, I found that after the recent (svn) update of the code the benchmark test for sphflake was failing. I then spent time on figuring out(using binary search) the bug and found that r50582 was responsible for the same.
 
  
−
===17 May 2012===
+
===3 July 2012===
−
* Working on a patch for the bench/pixcmp.c functionality.
+
* Web API set up. Mail has been sent to the mailing list asking folks to submit the logs through the API and mail.
 +
* Documentation, implement logging through out.
 +
* Read up about frontend forms for upload and data request.
 +
* The frontend is being setup through a special page which is the view part of the mediawiki extension.
  
−
===15 May 2012===
+
===1 July 2012===
−
* Set up a dummy database without much changes to the schema mentioned as a part of the proposal and then started writing crude parser scripts in python.
+
* Setting the demo server up. It is hosted at http://88.198.223.105 and that is being configured now for the demo purposes.
−
* Setup thrift on my machine. Had faced few difficulties setting it up with php 5.4.3 and Python 3.2 The issues with php 5.4.3 were resolved but the ones with Python 3.2 were quite a few specially related to the syntactic changes during the transition from 2.x to 3.x. Downgraded python to 2.7.3 and completed the setup. Yet to test the interlanguage communication. Shall do it tomorrow.
+
* Documentation of the work
  
−
===14 May 2012===
+
===30 Jun 2012===
−
* Experimenting with regexes for the benchmark log parsing.
+
* Integrating all the things worked on. Testing the process.
  
−
===13 May 2012===
+
===29 Jun 2012===
−
* Moved from ubuntu 12.04 which I did not really like to Archlinux and setup the work environment.
+
*
−
 
 
−
===12 May 2012===
 
−
 
 
−
* Set up mediawiki on the local machine and then was experimenting with the api.php of mediawiki.
 
−
 
 
−
===9 May 2012===
 
−
* Continued experimentation with the benchmark script and finally understood what each part of the code does.
 
−
* Working on a back-end design (Sent in a mail to the developer mailing list). Shall start working on the db design.
 
−
 
 
−
 
 
−
===8 May 2012===
 
−
* Continued experimentation with benchmark script and attempting to create the first patch by fixing the following block in the run.sh script.
 
−
 
 
−
    # FIXME: should really iterate one file at a time so we don't
 
−
    # just zero-pad at the end
 
−
    perf_VGRREF=`grep RTFM $perf_ref_files | sed -n -e 's/^.*= *//' -e 's/ rays.*//p' | tr '\012' '\011' `
 
−
    perf_CURVALS=`grep RTFM $perf_cur_files | sed -n -e 's/^.*= *//' -e 's/ rays.*//p' | tr '\012' '\011' `
 
−
 
 
−
* Working on a set of questions for design discussions.
 
−
 
 
−
 
 
−
 
 
−
===7 May 2012===
 
−
* Still looking into benchmark script and experimenting with that.
 
−
 
 
−
 
 
−
===4 May 2012===
 
−
* Compiled the brlcad(r50443) on my new setup of Ubuntu 12.04. Installation went on smoothly when librtserver JDK support was disabled.(I was trying various options during compilation.) When turned on, there were the error of it not being able to find jni.h even though the paths were fine. Looking into it at the moment.
 
−
* Could not understand why cmake was looking for STDCXX libs.
 
−
* Ran the benchmark on the machine and sent the report to benchmark@brlcad.org
 
−
* Started looking into the run.sh script to figure out how it really works.
 

Latest revision as of 09:20, 22 August 2012

22 August 2012[edit]

  • Tried running the bottle app on multi-threaded and asynchronous servers. Tested out Tornado. Currently running on python-paste

20 August 2012[edit]

  • Documentation

17-19 August 2012[edit]

  • Rolled out the crude website which is hosted at http://88.198.223.105:8080/
  • Upload page working on the localhost but buggy on the VPS
  • Documentation
  • Full of bugs, project immature

15-16 August 2012[edit]

  • Added views for the plots and configured the output to be presented via the template in the view
  • Made changes to existing folder structure for the Bottle app to run
  • Configured and made a run_server.py script
  • Source is at https://bitbucket.org/suryajith/benchmark/src
  • Awaiting Dr.Rai's perusal of the patches.

Absavgperfvsimagescomb.png Absavgperfvsimages2.png Absavgperfvsimages1.png Absavgperfvsarchpermhz.png Absavgperfvsarch.png


12-14 August 2012[edit]

  • Necessary changes in the db structure for the data needed for graphs
  • Necessary changes to the Parser script
  • Implemented
    • Absolute Performance vs Reference images over various architectures
    • Average Performance vs Architectures
    • Average Performance per CPU MHz vs Architectures
    • Absolute Performance vs CPU over various architectures
    • Absolute Performance vs CPU over various images for specific architecture
  • Forms for comparision between various architectures
  • Three modes of data displayed : text, table, graph
  • Below are some examples of the graphs generated from the data in the database

Perfvsimages.png Absavgperfpermhz.png Absavgperf.png

8-11 August 2012[edit]

  • MVC framework using bottle
  • Developed controllers for upload and basic charting libraries
  • Charting libraries : Wrapper over the GCharts by generating and thus embedding the js code

1-6 August 2012[edit]

  • More failed attempts at working with mediawiki

28-29 July 2012[edit]

  • Implemented a custom form renderer.
  • Results to be integrated.

21 July 2012[edit]

  • Realized that simpleforms do not help much and have begun writing the forms natively in PHP.

20 July 2012[edit]

  • Still figuring out the forms and the implementation of the actions

17-18 July 2012[edit]

  • Playing around with the Simple forms extension. Naive html forms wouldn't help as the action can't be hard coded.
  • It has some issues with mediawiki 1.20(alpha) due to some deprecations in the mediawiki codebase but figured out a few of them.


11-12 July 2012[edit]

  • Upload form on the special page.
  • Read up on Google charts embedding. Thoughts on the features required for the frontend.

9-10 July 2012[edit]

  • Documentation and fixing the flow. logging cleanup.
  • Frontend

5 July 2012[edit]

  • Read up the forms implementation for the frontend of mediawiki extension

3 July 2012[edit]

  • Web API set up. Mail has been sent to the mailing list asking folks to submit the logs through the API and mail.
  • Documentation, implement logging through out.
  • Read up about frontend forms for upload and data request.
  • The frontend is being setup through a special page which is the view part of the mediawiki extension.

1 July 2012[edit]

  • Setting the demo server up. It is hosted at http://88.198.223.105 and that is being configured now for the demo purposes.
  • Documentation of the work

30 Jun 2012[edit]

  • Integrating all the things worked on. Testing the process.

29 Jun 2012[edit]

Retrieved from "https://brlcad.org/w/index.php?title=User:Stattrav/GSoC2012_log&oldid=4368"