linux-kernel - Re: [PATCH 17/19] perf scripts python: exported-sql-viewer.py: Add All branches report

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <03696b24-b580-dfca-b991-f82dcc7a0176@intel.com>
Date:   Tue, 23 Oct 2018 11:20:29 +0300
From:   Adrian Hunter <adrian.hunter@...el.com>
To:     Arnaldo Carvalho de Melo <acme@...nel.org>
Cc:     Jiri Olsa <jolsa@...hat.com>, Andi Kleen <ak@...ux.intel.com>,
        linux-kernel@...r.kernel.org
Subject: Re: [PATCH 17/19] perf scripts python: exported-sql-viewer.py: Add
 All branches report

On 22/10/18 9:50 PM, Arnaldo Carvalho de Melo wrote:
> Em Mon, Oct 22, 2018 at 03:50:12PM -0300, Arnaldo Carvalho de Melo escreveu:
>> Em Mon, Oct 01, 2018 at 09:28:51AM +0300, Adrian Hunter escreveu:
>>> Add a report to display branches in a similar fashion to perf script. The
>>> main purpose of this report is to display disassembly, however, presently,
>>> the only supported disassembler is Intel XED, and additionally the object
>>> code must be present in perf build ID cache.
>>>
>>> To use Intel XED, libxed.so must be present. To build and install
>>> libxed.so:
>>> 	git clone https://github.com/intelxed/mbuild.git mbuild
>>> 	git clone https://github.com/intelxed/xed
>>> 	cd xed
>>> 	./mfile.py --share
>>> 	sudo ./mfile.py --prefix=/usr/local install
>>> 	sudo ldconfig
>>
>> The above set of instructions went further than when I tried following
>> Andi's instructions for testing the xed support in 'perf script', so I
>> tried to test this following committer notes I had added to:
>>
>>   4b715d24f4f1 perf tools: Add example call-graph script
>>
>> But now I'm getting this, what am I missing? I suggest you catch this
>> exception and provide hints about what is missing :-)
>>
>> - Arnaldo
>>
>> [acme@...et perf]$ perf script -i ~acme/perf.data.intel_pt -s ~/libexec/perf-core/scripts/python/export-to-postgresql.py pt_example branches calls
>> 2018-10-22 15:46:29.964938 Creating database...
>> QSqlDatabase: QPSQL driver not loaded
>> QSqlDatabase: available drivers: QSQLITE
>> QSqlDatabase: an instance of QCoreApplication is required for loading driver plugins
>> QSqlQuery::exec: database not open
>> Traceback (most recent call last):
>>   File "/home/acme/libexec/perf-core/scripts/python/export-to-postgresql.py", line 283, in <module>
>>     do_query(query, 'CREATE DATABASE ' + dbname)
>>   File "/home/acme/libexec/perf-core/scripts/python/export-to-postgresql.py", line 274, in do_query
>>     raise Exception("Query failed: " + q.lastError().text())
>> Exception: Query failed: Driver not loaded Driver not loaded
>> Error running python script /home/acme/libexec/perf-core/scripts/python/export-to-postgresql.py
>> [acme@...et perf]$
>>
>> [root@...et perf]# rpm -qa | grep -i sqlite
>> sqlite-debuginfo-3.14.2-1.fc25.x86_64
>> sqlite2-2.8.17-20.fc26.x86_64
>> sqlite-3.20.1-3.fc27.x86_64
>> sqlite-libs-3.20.1-3.fc27.x86_64
>> [root@...et perf]#
> 
> Installed:
> 
> python-sqlite3dbm-0.1.4-10.fc27.noarch
> 
> didn't help
> 

The sqlite export script is a different script to the postgresql export
script.  The sqlite export script is called "export-to-sqlite.py".  From the
output above "QSqlDatabase: available drivers: QSQLITE", it looks like
sqlite should work. i.e.

   $ perf script -i ~acme/perf.data.intel_pt -s
~/libexec/perf-core/scripts/python/export-to-sqlite.py pt_example branches calls

Working with postgresql requires more setup (although it becomes
increasingly more efficient than sqlite as the data size increases).

For postgresql, according to the "export-to-postgresql.py" script comments,
the packages needed are:

fedora:
   $ sudo yum install postgresql postgresql-server python-pyside \
   qt-postgresql

ubuntu:
   $ sudo apt-get install postgresql python-pyside.qtsql libqt4-sql-psql

But a postgresql server must be configured and running also.  According to
"export-to-postgresql.py" comments:

fedora:
   $ sudo su - postgres -c initdb
   $ sudo service postgresql start
   $ sudo su - postgres
   $ createuser <your user id here>
   Shall the new role be a superuser? (y/n) y

ubuntu:
   $ sudo su - postgres
   $ createuser -s <your user id here>


Please also note that I have sent a V2 of this patch with a minor fix.