Perl/Profiling - Revision history

Admin: /* Resources */

2017-03-20T02:16:08Z

Resources

← Older revision		Revision as of 02:16, 20 March 2017
Line 133:		Line 133:

	[[Image:NYTProf3.png\|500px]]		[[Image:NYTProf3.png\|500px]]

			=Timing Code=

			See [[Perl/Timing]]

	=Resources=		=Resources=

Admin: /* Profiling Code using SizeMe */

2017-03-19T22:38:02Z

Profiling Code using SizeMe

← Older revision		Revision as of 22:38, 19 March 2017
Line 40:		Line 40:

	Hat tip to SO user @TimBunce (author of SizeMe) for pointing out the SizeMe module for profiling Perl heap memory usage: http://stackoverflow.com/a/12821590/463213		Hat tip to SO user @TimBunce (author of SizeMe) for pointing out the SizeMe module for profiling Perl heap memory usage: http://stackoverflow.com/a/12821590/463213



	=Profiling Code using NYTProf=		=Profiling Code using NYTProf=

Admin: /* Profiling Code using the NYTProf */

2017-03-19T22:37:51Z

Profiling Code using the NYTProf

← Older revision		Revision as of 22:37, 19 March 2017
Line 35:		Line 35:
	This also installs the dependencies, of which there are multiple: https://metacpan.org/pod/Devel::NYTProf		This also installs the dependencies, of which there are multiple: https://metacpan.org/pod/Devel::NYTProf

	=Profiling Code using the NYTProf=		=Profiling Code using SizeMe=

			Official page: http://search.cpan.org/~timb/Devel-SizeMe-0.19/lib/Devel/SizeMe.pm

			Hat tip to SO user @TimBunce (author of SizeMe) for pointing out the SizeMe module for profiling Perl heap memory usage: http://stackoverflow.com/a/12821590/463213



			=Profiling Code using NYTProf=

	Normally, we can time code using the <code>time</code> function, which gives a really high-level description of how long the code took to do stuff. Like, "this much user time, this much real wall time." Here's an example of output from the time command:		Normally, we can time code using the <code>time</code> function, which gives a really high-level description of how long the code took to do stuff. Like, "this much user time, this much real wall time." Here's an example of output from the time command:

Admin: /* Installing NYTProf */

2017-03-19T22:35:36Z

Installing NYTProf

← Older revision		Revision as of 22:35, 19 March 2017
Line 13:		Line 13:
	</pre>		</pre>

	==Installing NYTProf==		==Installing Perl Profiling Tools==

			===SizeMe===

			Install SizeMe: http://search.cpan.org/~timb/Devel-SizeMe-0.19/lib/Devel/SizeMe.pm

			<pre>
			$ cpanm Devel::SizeMe
			</pre>

			Hat tip: https://stackoverflow.com/questions/6645073/profiling-heap-memory-usage-on-perl-programs#6645561

			===NYTProf===

	Install the best Perl profiling tool out there, the NYTProf, originally written by Adam Kaplan at the New York Times: https://www.perl.org/about/whitepapers/perl-profiling.html		Install the best Perl profiling tool out there, the NYTProf, originally written by Adam Kaplan at the New York Times: https://www.perl.org/about/whitepapers/perl-profiling.html

	<pre>		<pre>
	cpanm Devel::NYTProf		$ cpanm Devel::NYTProf
	</pre>		</pre>

	This also installs the dependencies, of which there are multiple: https://metacpan.org/pod/Devel::NYTProf		This also installs the dependencies, of which there are multiple: https://metacpan.org/pod/Devel::NYTProf


	=Profiling Code using the NYTProf=		=Profiling Code using the NYTProf=

Admin: /* NYTProf csv format */

2017-03-19T20:53:30Z

NYTProf csv format

← Older revision		Revision as of 20:53, 19 March 2017
Line 95:		Line 95:
	}}		}}

	From this we can see ~~most of~~ the ~~time~~		From this we can see the bottlenecks are the for loop over each column, and populating the attacked array.

	===NYTProf html format===		===NYTProf html format===

Admin: /* NYTProf */

2017-03-19T20:52:30Z

NYTProf

← Older revision		Revision as of 20:52, 19 March 2017
Line 123:		Line 123:
	Official package info (some documentation, but nothing high-level at all): https://metacpan.org/pod/Devel::NYTProf		Official package info (some documentation, but nothing high-level at all): https://metacpan.org/pod/Devel::NYTProf

	Slide deck explaining a bit more about how to use NYTProf: www.slideshare.net/Tim.Bunce/develnytprof-200907		Slide deck explaining a bit more about how to use NYTProf: http://www.slideshare.net/Tim.Bunce/develnytprof-200907

Admin: /* NYTProf csv format */

2017-03-19T20:51:32Z

NYTProf csv format

← Older revision		Revision as of 20:51, 19 March 2017
Line 80:		Line 80:
	# More information at http://metacpan.org/release/Devel-NYTProf/		# More information at http://metacpan.org/release/Devel-NYTProf/
	# Format: time,calls,time/call,code		# Format: time,calls,time/call,code
	0.~~000001~~,1,0.000001,my @~~solutions~~;		0.086191,166926,0.000001,my ($depth, @attacked) = shift;
	0.~~010062~~,2680,0.000004,push @solutions, "@queens\n";		0.010183,2680,0.000004,push @solutions, "@queens\n";
	0.~~010504~~,2680,0.000004,return;		0.010521,2680,0.000004,return;
	0.~~179363~~,164246,0.000001,$#attacked = $board_size;		0.196345,164246,0.000001,$#attacked = 2 * $board_size;
	0.~~146662~~,164246,0.000001,for( 0 .. $#queens) {		0.152597,164246,0.000001,for( 0 .. $#queens) {
	0.~~763039~~,1.26035e+06,0.000001,~~if((~~$~~ix2<$board_size &&~~ $ix2>=~~0)){~~		0.683294,1.26035e+06,0.000001,$attacked[ $ix2 ] = 1;
	1.~~204790~~,164246,0.000007,for my $row (0 .. $board_size-1) {		1.189223,164246,0.000007,for my $row (0 .. $board_size-1) {
	0.~~276075~~,166925,0.000002,explore($depth+1);		0.272883,166925,0.000002,explore($depth+1);
	0.~~120680~~,166925,0.000001,$occupied[$row] = 0;		0.116465,166925,0.000001,$occupied[$row] = 0;
			0.000001,1,0.000001,$board_size = 11;
	0.000019,1,0.000019,explore(0);		0.000019,1,0.000019,explore(0);
	0.~~000083~~,1,0.~~000083~~,print "Found ", scalar(@solutions), " solutions\n";		0.000080,1,0.000080,print "Found ", scalar(@solutions), " solutions\n";
	</pre>		</pre>
	}}		}}

			From this we can see most of the time

	===NYTProf html format===		===NYTProf html format===

Admin: /* NYTProf csv format */

2017-03-19T20:47:34Z

NYTProf csv format

← Older revision		Revision as of 20:47, 19 March 2017
Line 74:		Line 74:

	{{Scroll box\|		{{Scroll box\|

	<pre>		<pre>
	~~$ cat nqueens-pl-1-line.csv \| /usr/bin/grep -v "0.000000"~~
	# Profile data generated by Devel::NYTProf::Reader		# Profile data generated by Devel::NYTProf::Reader
	# Version: v6.04		# Version: v6.04

Admin: /* NYTProf csv format */

2017-03-19T20:47:19Z

NYTProf csv format

@@ Line 65: / Line 65: @@
 ===NYTProf csv format===
-For n = 13:
+Now you can run <code>nytprofcsv</code> to turn that output into a CSV file, one line per line of code, with a summary of where all the time was spent:
-/usr/local/Cellar/perl/5.24.0_1/bin/nytprofcsv
+<pre>
 ===NYTProf html format===

Admin: /* Running with NYTProf */

2017-03-19T09:08:07Z

Running with NYTProf

← Older revision		Revision as of 09:08, 19 March 2017
Line 62:		Line 62:
	* nytprofcfg - generates nytprof.callgraph		* nytprofcfg - generates nytprof.callgraph
	* nytprofhtml - generate html version		* nytprofhtml - generate html version

			===NYTProf csv format===

			For n = 13:

			/usr/local/Cellar/perl/5.24.0_1/bin/nytprofcsv

	===NYTProf html format===		===NYTProf html format===