lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Date:	Mon, 10 Aug 2015 10:46:09 -0300
From:	Arnaldo Carvalho de Melo <acme@...nel.org>
To:	Jiri Olsa <jolsa@...hat.com>
Cc:	Kan Liang <kan.liang@...el.com>, Jiri Olsa <jolsa@...nel.org>,
	Namhyung Kim <namhyung@...nel.org>,
	Andi Kleen <ak@...ux.intel.com>, linux-kernel@...r.kernel.org
Subject: Re: [PATCH RFC V9 2/3] perf,tools: per-event callgraph support

Em Sat, Aug 08, 2015 at 06:45:39PM +0200, Jiri Olsa escreveu:
> On Fri, Aug 07, 2015 at 12:49:38PM -0300, Arnaldo Carvalho de Melo wrote:
> > Em Fri, Aug 07, 2015 at 12:38:43PM -0300, Arnaldo Carvalho de Melo escreveu:
> > > Em Thu, Aug 06, 2015 at 03:44:53PM -0400, kan.liang@...el.com escreveu:
> > > > From: Kan Liang <kan.liang@...el.com>
> > > > Here are some examples and test results.
> > > > 
> > > > 1. Comparing the elapsed time and perf.data size from "kernbench -M -H".
> > > > 
> > > >  The test command for FULL callgraph and time support.
> > > >    "perf record -e
> > > >    '{cpu/cpu-cycles,period=100000/,cpu/instructions,period=20000/p}'
> > > >    --call-graph fp --time"
> > 
> > Some other oddity I noticed while testing:
> > 
> 
> SNIP
> 
> > This is in the 'perf report' TUI, why, for an event with 'callgraph=no', we
> > get callchains? How come?
> > 
> > If I try it with the --stdio, well, its there as well:
> > 
> > # Samples: 2K of event 'cpu/instructions,call-graph=no,time=0,period=20000/p'
> > # Event count (approx.): 46956518
> > #
> > # Children      Self  Command          Shared Object               Symbol                                        
> > # ........  ........  ...............  ..........................  ..............................................
> > #
> >     67.56%     0.00%  qemu-system-x86  [unknown]                   [.] 0xad5e258d4c544155                        
> >             |
> >             ---0xad5e258d4c544155
> > 
> >     67.56%     0.00%  qemu-system-x86  libc-2.20.so                [.] __libc_start_main                         
> >             |
> >             ---__libc_start_main
> >                0xad5e258d4c544155
> > 
> >     67.56%     0.00%  qemu-system-x86  perf                        [.] main                                      
> >             |
> >             ---main
> >                __libc_start_main
> >                0xad5e258d4c544155
> > 
> >     67.56%     0.00%  qemu-system-x86  perf                        [.] run_builtin                               
> >             |
> >             ---run_builtin
> >                main
> >                __libc_start_main
> >                0xad5e258d4c544155
> > 
> > Can you take a look? What I have, i.e. the patches from Jiri and Kan
> > moving stuff out of the way of the python binding and this patch is at
> > the tmp.perf/core branch in my git tree:
> > 
> >   git://git.kernel.org/pub/scm/linux/kernel/git/acme/linux.git
> 
> hum, tried this branch and got proper behaviour for both stdio and TUI,

Well, from what he explained to me, the proper behaviour was the one I
got, i.e. one event has call-graph=fp, and thus the perf_event_attr
fields for callchains will be set up as always, and the other, with
call-graph=no, will not ask the kernel for callchains, thus saving
space, but report _will_ show callchains for it, using the callchains
obtained for the first event.

So, "call-graph=no" doesn't mean you don't want callchains for a
particular events _if_ there is another event in the group for which
callchains is available.

But if "call-graph=no" for all events, then, yes, "no" means really
"no". :-)

I think we should use "call-graph=ref" to mean that no callchains should
be requested to the kernel infrastructure but that when doing the
report, use callchains available in some other event (perhaps would be
good to specify which one), while "call-graph=no" really means "no",
i.e. no callchains asked from the kernel for this event, and _no_
callchains to appear on report.

- Arnaldo

> attaching stdio output
> 
> the record command was:
>   $ ./perf record -e 'cpu/cpu-cycles,call-graph=fp,time,period=10000/pp,cpu/instructions,call-graph=no,time=0,period=20000/p' ls
> 
> got the events strings from your report output.. what was different in your record command?
> 
> jirka

> # To display the perf.data header info, please use --header/--header-only options.
> #
> #
> # Total Lost Samples: 4
> #
> # Samples: 95  of event 'cpu/cpu-cycles,call-graph=fp,time,period=10000/pp'
> # Event count (approx.): 7487606
> #
> # Children      Self  Command  Shared Object       Symbol                               
> # ........  ........  .......  ..................  .....................................
> #
>     61.66%     0.00%  ls       [kernel.vmlinux]    [k] entry_SYSCALL_64_fastpath        
>                  |
>                  ---entry_SYSCALL_64_fastpath
>                     |          
>                     |--55.19%-- open64
>                     |          0x686361632e6f732e
>                     |          
>                     |--21.81%-- __GI___libc_write
>                     |          |          
>                     |          |--24.74%-- 0x6e69746c69756220
>                     |          |          
>                     |          |--19.20%-- 0x909632e66666964
>                     |          |          
>                     |          |--18.35%-- 0x657461746f6e6e61
>                     |          |          
>                     |          |--16.05%-- 0x1dbdc70
>                     |          |          
>                     |          |--11.32%-- 0
>                     |          |          
>                     |           --10.34%-- 0x9096f2e61746164
>                     |          
>                     |--6.18%-- __getdents64
>                     |          
>                     |--5.00%-- mmap64
>                     |          |          
>                     |          |--50.39%-- _dl_check_all_versions
>                     |          |          
>                     |           --49.61%-- _dl_map_object
>                     |                     0x213988
>                     |                     0
>                     |          
>                     |--2.72%-- mprotect
>                     |          dl_main
>                     |          _dl_sysdep_start
>                     |          
>                     |--1.26%-- _exit
>                     |          __run_exit_handlers
>                     |          0
>                     |          
>                     |--0.92%-- __GI___munmap
>                      --6.92%-- [...]
> 
>     34.03%     0.00%  ls       [unknown]           [.] 0x686361632e6f732e               
>                  |
>                  ---0x686361632e6f732e
> 
>     34.03%     0.00%  ls       ld-2.18.so          [.] open64                           
>                  |
>                  ---open64
>                     0x686361632e6f732e
> 
>     34.03%     0.00%  ls       [kernel.vmlinux]    [k] sys_open                         
>                  |
>                  ---sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     34.03%     0.00%  ls       [kernel.vmlinux]    [k] do_sys_open                      
>                  |
>                  ---do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     34.03%     0.00%  ls       [kernel.vmlinux]    [k] do_filp_open                     
>                  |
>                  ---do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     34.03%     0.00%  ls       [kernel.vmlinux]    [k] path_openat                      
>                  |
>                  ---path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     34.03%     0.00%  ls       [kernel.vmlinux]    [k] link_path_walk                   
>                  |
>                  ---link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     34.03%     0.00%  ls       [kernel.vmlinux]    [k] inode_permission                 
>                  |
>                  ---inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     34.03%     0.00%  ls       [kernel.vmlinux]    [k] __inode_permission               
>                  |
>                  ---__inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     33.75%     0.00%  ls       [kernel.vmlinux]    [k] irq_work_interrupt               
>                  |
>                  ---irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     33.75%     0.00%  ls       [kernel.vmlinux]    [k] smp_irq_work_interrupt           
>                  |
>                  ---smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     33.75%     0.00%  ls       [kernel.vmlinux]    [k] irq_work_run                     
>                  |
>                  ---irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     33.75%     0.00%  ls       [kernel.vmlinux]    [k] irq_work_run_list                
>                  |
>                  ---irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     33.75%     0.00%  ls       [kernel.vmlinux]    [k] perf_duration_warn               
>                  |
>                  ---perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     33.75%     0.00%  ls       [kernel.vmlinux]    [k] printk                           
>                  |
>                  ---printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     33.75%     0.00%  ls       [kernel.vmlinux]    [k] vprintk_default                  
>                  |
>                  ---vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     33.75%     0.00%  ls       [kernel.vmlinux]    [k] vprintk_emit                     
>                  |
>                  ---vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     33.75%     0.00%  ls       [kernel.vmlinux]    [k] console_unlock                   
>                  |
>                  ---console_unlock
>                     vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     33.43%     0.00%  ls       [kernel.vmlinux]    [k] call_console_drivers.constprop.27
>                  |
>                  ---call_console_drivers.constprop.27
>                     console_unlock
>                     vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     33.43%     0.00%  ls       [kernel.vmlinux]    [k] univ8250_console_write           
>                  |
>                  ---univ8250_console_write
>                     call_console_drivers.constprop.27
>                     console_unlock
>                     vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     33.43%     0.00%  ls       [kernel.vmlinux]    [k] uart_console_write               
>                  |
>                  ---uart_console_write
>                     univ8250_console_write
>                     call_console_drivers.constprop.27
>                     console_unlock
>                     vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     33.43%     0.00%  ls       [kernel.vmlinux]    [k] serial8250_console_putchar       
>                  |
>                  ---serial8250_console_putchar
>                     uart_console_write
>                     univ8250_console_write
>                     call_console_drivers.constprop.27
>                     console_unlock
>                     vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     28.96%     0.00%  ls       [kernel.vmlinux]    [k] wait_for_xmitr                   
>                  |
>                  ---wait_for_xmitr
>                     serial8250_console_putchar
>                     uart_console_write
>                     univ8250_console_write
>                     call_console_drivers.constprop.27
>                     console_unlock
>                     vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     17.71%     0.00%  ls       libc-2.18.so        [.] __GI___libc_write                
>                  |
>                  ---__GI___libc_write
>                     |          
>                     |--16.81%-- 0x657461746f6e6e61
>                     |          
>                     |--10.79%-- 0x6e69746c69756220
>                     |          
>                     |--8.37%-- 0x909632e66666964
>                     |          
>                     |--7.00%-- 0x1dbdc70
>                     |          
>                     |--6.67%-- 0x96f2e68636e6562
>                     |          
>                     |--5.30%-- 0x2d6469646c697562
>                     |          
>                     |--4.93%-- 0
>                     |          
>                     |--4.51%-- 0x9096f2e61746164
>                     |          
>                     |--3.30%-- 0x6f2e7473696c7665
>                      --32.32%-- [...]
> 
>     14.14%     0.41%  ls       [kernel.vmlinux]    [k] __const_udelay                   
>                  |
>                  ---__const_udelay
>                     |          
>                     |--97.12%-- wait_for_xmitr
>                     |          serial8250_console_putchar
>                     |          uart_console_write
>                     |          univ8250_console_write
>                     |          call_console_drivers.constprop.27
>                     |          console_unlock
>                     |          vprintk_emit
>                     |          vprintk_default
>                     |          printk
>                     |          perf_duration_warn
>                     |          irq_work_run_list
>                     |          irq_work_run
>                     |          smp_irq_work_interrupt
>                     |          irq_work_interrupt
>                     |          __inode_permission
>                     |          inode_permission
>                     |          link_path_walk
>                     |          path_openat
>                     |          do_filp_open
>                     |          do_sys_open
>                     |          sys_open
>                     |          entry_SYSCALL_64_fastpath
>                     |          open64
>                     |          0x686361632e6f732e
>                     |          
>                      --2.88%-- serial8250_console_putchar
>                                uart_console_write
>                                univ8250_console_write
>                                call_console_drivers.constprop.27
>                                console_unlock
>                                vprintk_emit
>                                vprintk_default
>                                printk
>                                perf_duration_warn
>                                irq_work_run_list
>                                irq_work_run
>                                smp_irq_work_interrupt
>                                irq_work_interrupt
>                                __inode_permission
>                                inode_permission
>                                link_path_walk
>                                path_openat
>                                do_filp_open
>                                do_sys_open
>                                sys_open
>                                entry_SYSCALL_64_fastpath
>                                open64
>                                0x686361632e6f732e
> 
>     13.75%    13.75%  ls       [kernel.vmlinux]    [k] io_serial_in                     
>                  |
>                  ---io_serial_in
>                     wait_for_xmitr
>                     serial8250_console_putchar
>                     uart_console_write
>                     univ8250_console_write
>                     call_console_drivers.constprop.27
>                     console_unlock
>                     vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>     13.45%     0.00%  ls       [kernel.vmlinux]    [k] sys_write                        
>                  |
>                  ---sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     |          
>                     |--14.21%-- 0x6e69746c69756220
>                     |          
>                     |--11.03%-- 0x909632e66666964
>                     |          
>                     |--10.54%-- 0x657461746f6e6e61
>                     |          
>                     |--9.22%-- 0x1dbdc70
>                     |          
>                     |--6.50%-- 0
>                     |          
>                     |--5.94%-- 0x9096f2e61746164
>                      --42.57%-- [...]
> 
>     13.45%     0.00%  ls       [kernel.vmlinux]    [k] vfs_write                        
>                  |
>                  ---vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     |          
>                     |--14.21%-- 0x6e69746c69756220
>                     |          
>                     |--11.03%-- 0x909632e66666964
>                     |          
>                     |--10.54%-- 0x657461746f6e6e61
>                     |          
>                     |--9.22%-- 0x1dbdc70
>                     |          
>                     |--6.50%-- 0
>                     |          
>                     |--5.94%-- 0x9096f2e61746164
>                      --42.57%-- [...]
> 
>     13.45%     0.00%  ls       [kernel.vmlinux]    [k] __vfs_write                      
>                  |
>                  ---__vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     |          
>                     |--14.21%-- 0x6e69746c69756220
>                     |          
>                     |--11.03%-- 0x909632e66666964
>                     |          
>                     |--10.54%-- 0x657461746f6e6e61
>                     |          
>                     |--9.22%-- 0x1dbdc70
>                     |          
>                     |--6.50%-- 0
>                     |          
>                     |--5.94%-- 0x9096f2e61746164
>                      --42.57%-- [...]
> 
>     13.45%     0.00%  ls       [kernel.vmlinux]    [k] tty_write                        
>                  |
>                  ---tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     |          
>                     |--14.21%-- 0x6e69746c69756220
>                     |          
>                     |--11.03%-- 0x909632e66666964
>                     |          
>                     |--10.54%-- 0x657461746f6e6e61
>                     |          
>                     |--9.22%-- 0x1dbdc70
>                     |          
>                     |--6.50%-- 0
>                     |          
>                     |--5.94%-- 0x9096f2e61746164
>                      --42.57%-- [...]
> 
>     13.45%     0.00%  ls       [kernel.vmlinux]    [k] n_tty_write                      
>                  |
>                  ---n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     |          
>                     |--14.21%-- 0x6e69746c69756220
>                     |          
>                     |--11.03%-- 0x909632e66666964
>                     |          
>                     |--10.54%-- 0x657461746f6e6e61
>                     |          
>                     |--9.22%-- 0x1dbdc70
>                     |          
>                     |--6.50%-- 0
>                     |          
>                     |--5.94%-- 0x9096f2e61746164
>                      --42.57%-- [...]
> 
>     12.39%    12.39%  ls       [kernel.vmlinux]    [k] delay_tsc                        
>                  |
>                  ---delay_tsc
>                     |          
>                     |--88.16%-- __const_udelay
>                     |          wait_for_xmitr
>                     |          serial8250_console_putchar
>                     |          uart_console_write
>                     |          univ8250_console_write
>                     |          call_console_drivers.constprop.27
>                     |          console_unlock
>                     |          vprintk_emit
>                     |          vprintk_default
>                     |          printk
>                     |          perf_duration_warn
>                     |          irq_work_run_list
>                     |          irq_work_run
>                     |          smp_irq_work_interrupt
>                     |          irq_work_interrupt
>                     |          __inode_permission
>                     |          inode_permission
>                     |          link_path_walk
>                     |          path_openat
>                     |          do_filp_open
>                     |          do_sys_open
>                     |          sys_open
>                     |          entry_SYSCALL_64_fastpath
>                     |          open64
>                     |          0x686361632e6f732e
>                     |          
>                      --11.84%-- wait_for_xmitr
>                                serial8250_console_putchar
>                                uart_console_write
>                                univ8250_console_write
>                                call_console_drivers.constprop.27
>                                console_unlock
>                                vprintk_emit
>                                vprintk_default
>                                printk
>                                perf_duration_warn
>                                irq_work_run_list
>                                irq_work_run
>                                smp_irq_work_interrupt
>                                irq_work_interrupt
>                                __inode_permission
>                                inode_permission
>                                link_path_walk
>                                path_openat
>                                do_filp_open
>                                do_sys_open
>                                sys_open
>                                entry_SYSCALL_64_fastpath
>                                open64
>                                0x686361632e6f732e
> 
>      9.88%     0.00%  ls       [unknown]           [.] 0x0000000000841f0f               
>                  |
>                  ---0x841f0f
> 
>      9.16%     0.00%  ls       [kernel.vmlinux]    [k] pty_write                        
>                  |
>                  ---pty_write
>                     |          
>                     |--45.92%-- n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--72.50%-- 0x6e69746c69756220
>                     |          |          
>                     |           --27.50%-- 0x909632e66666964
>                     |          
>                     |--31.59%-- do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--69.57%-- 0x657461746f6e6e61
>                     |          |          
>                     |           --30.43%-- 0x1dbdc70
>                     |          
>                      --22.49%-- tty_put_char
>                                do_output_char
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
> 
>      9.16%     0.00%  ls       [kernel.vmlinux]    [k] tty_flip_buffer_push             
>                  |
>                  ---tty_flip_buffer_push
>                     pty_write
>                     |          
>                     |--45.92%-- n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--72.50%-- 0x6e69746c69756220
>                     |          |          
>                     |           --27.50%-- 0x909632e66666964
>                     |          
>                     |--31.59%-- do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--69.57%-- 0x657461746f6e6e61
>                     |          |          
>                     |           --30.43%-- 0x1dbdc70
>                     |          
>                      --22.49%-- tty_put_char
>                                do_output_char
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
> 
>      9.16%     0.00%  ls       [kernel.vmlinux]    [k] tty_schedule_flip                
>                  |
>                  ---tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     |          
>                     |--45.92%-- n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--72.50%-- 0x6e69746c69756220
>                     |          |          
>                     |           --27.50%-- 0x909632e66666964
>                     |          
>                     |--31.59%-- do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--69.57%-- 0x657461746f6e6e61
>                     |          |          
>                     |           --30.43%-- 0x1dbdc70
>                     |          
>                      --22.49%-- tty_put_char
>                                do_output_char
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
> 
>      9.16%     0.00%  ls       [kernel.vmlinux]    [k] queue_work_on                    
>                  |
>                  ---queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     |          
>                     |--45.92%-- n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--72.50%-- 0x6e69746c69756220
>                     |          |          
>                     |           --27.50%-- 0x909632e66666964
>                     |          
>                     |--31.59%-- do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--69.57%-- 0x657461746f6e6e61
>                     |          |          
>                     |           --30.43%-- 0x1dbdc70
>                     |          
>                      --22.49%-- tty_put_char
>                                do_output_char
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
> 
>      9.16%     0.00%  ls       [kernel.vmlinux]    [k] __queue_work                     
>                  |
>                  ---__queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     |          
>                     |--45.92%-- n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--72.50%-- 0x6e69746c69756220
>                     |          |          
>                     |           --27.50%-- 0x909632e66666964
>                     |          
>                     |--31.59%-- do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--69.57%-- 0x657461746f6e6e61
>                     |          |          
>                     |           --30.43%-- 0x1dbdc70
>                     |          
>                      --22.49%-- tty_put_char
>                                do_output_char
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
> 
>      9.16%     1.30%  ls       [kernel.vmlinux]    [k] insert_work                      
>                  |
>                  ---insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     |          
>                     |--45.92%-- n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--72.50%-- 0x6e69746c69756220
>                     |          |          
>                     |           --27.50%-- 0x909632e66666964
>                     |          
>                     |--31.59%-- do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--69.57%-- 0x657461746f6e6e61
>                     |          |          
>                     |           --30.43%-- 0x1dbdc70
>                     |          
>                      --22.49%-- tty_put_char
>                                do_output_char
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
> 
>      8.41%     0.00%  ls       [unknown]           [.] 0000000000000000                 
>                  |
>                  ---0
>                     |          
>                     |--15.30%-- 0x632e74617473
>                     |          
>                     |--12.88%-- 0
>                     |          
>                     |--12.01%-- 0x72616863656d6974
>                      --59.81%-- [...]
> 
>      7.92%     0.00%  ls       ls                  [.] 0xffffffffffc0e1cf               
>                  |
>                  ---0xe1cf
>                     0x841f0f
> 
>      6.97%     0.00%  ls       [kernel.vmlinux]    [k] wake_up_worker                   
>                  |
>                  ---wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     |          
>                     |--37.80%-- n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--72.50%-- 0x6e69746c69756220
>                     |          |          
>                     |           --27.50%-- 0x909632e66666964
>                     |          
>                     |--32.63%-- do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |           --100.00%-- 0x657461746f6e6e61
>                     |          
>                      --29.57%-- tty_put_char
>                                do_output_char
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
> 
>      6.97%     0.00%  ls       [kernel.vmlinux]    [k] wake_up_process                  
>                  |
>                  ---wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     |          
>                     |--37.80%-- n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--72.50%-- 0x6e69746c69756220
>                     |          |          
>                     |           --27.50%-- 0x909632e66666964
>                     |          
>                     |--32.63%-- do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |           --100.00%-- 0x657461746f6e6e61
>                     |          
>                      --29.57%-- tty_put_char
>                                do_output_char
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
> 
>      6.97%     0.00%  ls       [kernel.vmlinux]    [k] try_to_wake_up                   
>                  |
>                  ---try_to_wake_up
>                     wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     |          
>                     |--37.80%-- n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--72.50%-- 0x6e69746c69756220
>                     |          |          
>                     |           --27.50%-- 0x909632e66666964
>                     |          
>                     |--32.63%-- do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |           --100.00%-- 0x657461746f6e6e61
>                     |          
>                      --29.57%-- tty_put_char
>                                do_output_char
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
> 
>      6.97%     0.00%  ls       [kernel.vmlinux]    [k] ttwu_do_activate.constprop.92    
>                  |
>                  ---ttwu_do_activate.constprop.92
>                     try_to_wake_up
>                     wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     |          
>                     |--37.80%-- n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--72.50%-- 0x6e69746c69756220
>                     |          |          
>                     |           --27.50%-- 0x909632e66666964
>                     |          
>                     |--32.63%-- do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |           --100.00%-- 0x657461746f6e6e61
>                     |          
>                      --29.57%-- tty_put_char
>                                do_output_char
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
> 
>      5.94%     5.94%  ls       libc-2.18.so        [.] get_next_seq                     
>                  |
>                  ---get_next_seq
>                     0xe1cf
>                     0x841f0f
> 
>      5.80%     0.00%  ls       [kernel.vmlinux]    [k] __schedule                       
>                  |
>                  ---__schedule
>                     |          
>                     |--73.77%-- preempt_schedule_common
>                     |          _cond_resched
>                     |          mutex_lock
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--28.65%-- 0
>                     |          |          
>                     |          |--26.18%-- 0x9096f2e61746164
>                     |          |          
>                     |          |--24.86%-- 0x909632e66666964
>                     |          |          
>                     |           --20.31%-- 0x1dbdc70
>                     |          
>                      --26.23%-- schedule
>                                prepare_exit_to_usermode
>                                syscall_return_slowpath
>                                int_ret_from_sys_call
>                                __GI___libc_write
>                                |          
>                                |--61.62%-- 0x2d6469646c697562
>                                |          
>                                 --38.38%-- 0x6f2e7473696c7665
> 
>      5.75%     1.94%  ls       libc-2.18.so        [.] __getdents64                     
>                  |
>                  ---__getdents64
>                     |          
>                     |--33.68%-- 0x616863656d69742d
>                      --66.32%-- [...]
> 
>      5.04%     0.00%  ls       [kernel.vmlinux]    [k] 0x000000007f47cb44               
>                  |
>                  ---0x27cb44
>                     entry_SYSCALL_64_fastpath
>                     |          
>                     |--15.40%-- _exit
>                     |          __run_exit_handlers
>                     |          0
>                      --84.60%-- [...]
> 
>      5.04%     0.00%  ls       [kernel.vmlinux]    [k] do_group_exit                    
>                  |
>                  ---do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
>                     |          
>                     |--15.40%-- _exit
>                     |          __run_exit_handlers
>                     |          0
>                      --84.60%-- [...]
> 
>      5.04%     0.78%  ls       [kernel.vmlinux]    [k] do_exit                          
>                  |
>                  ---do_exit
>                     do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
>                     |          
>                     |--15.40%-- _exit
>                     |          __run_exit_handlers
>                     |          0
>                      --84.60%-- [...]
> 
>      4.96%     0.00%  ls       [kernel.vmlinux]    [k] do_output_char                   
>                  |
>                  ---do_output_char
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     |          
>                     |--28.59%-- 0x657461746f6e6e61
>                     |          
>                     |--12.51%-- 0x1dbdc70
>                      --58.90%-- [...]
> 
>      4.79%     4.79%  ls       [kernel.vmlinux]    [k] native_write_msr_safe            
>                  |
>                  ---native_write_msr_safe
>                     |          
>                     |--37.79%-- __intel_pmu_disable_all
>                     |          intel_pmu_disable_all
>                     |          x86_pmu_disable
>                     |          perf_pmu_disable
>                     |          ctx_sched_out
>                     |          __perf_event_task_sched_out
>                     |          __schedule
>                     |          |          
>                     |          |--51.77%-- schedule
>                     |          |          prepare_exit_to_usermode
>                     |          |          syscall_return_slowpath
>                     |          |          int_ret_from_sys_call
>                     |          |          __GI___libc_write
>                     |          |          0x2d6469646c697562
>                     |          |          
>                     |           --48.23%-- preempt_schedule_common
>                     |                     _cond_resched
>                     |                     mutex_lock
>                     |                     n_tty_write
>                     |                     tty_write
>                     |                     __vfs_write
>                     |                     vfs_write
>                     |                     sys_write
>                     |                     entry_SYSCALL_64_fastpath
>                     |                     __GI___libc_write
>                     |                     0
>                     |          
>                     |--32.55%-- __GI___libc_write
>                     |          0x657461746f6e6e61
>                     |          
>                     |--29.58%-- __intel_pmu_enable_all.isra.9
>                     |          intel_pmu_enable_all
>                     |          x86_pmu_enable
>                     |          perf_pmu_enable
>                     |          |          
>                     |          |--56.32%-- perf_event_context_sched_in
>                     |          |          |          
>                     |          |          |--100.00%-- __perf_event_task_sched_in
>                     |          |          |          finish_task_switch
>                     |          |          |          __schedule
>                     |          |          |          preempt_schedule_common
>                     |          |          |          _cond_resched
>                     |          |          |          mutex_lock
>                     |          |          |          n_tty_write
>                     |          |          |          tty_write
>                     |          |          |          __vfs_write
>                     |          |          |          vfs_write
>                     |          |          |          sys_write
>                     |          |          |          entry_SYSCALL_64_fastpath
>                     |          |          |          __GI___libc_write
>                     |          |          |          0x9096f2e61746164
>                     |          |           --0.00%-- [...]
>                     |          |          
>                     |           --43.68%-- perf_pmu_sched_task
>                     |                     __perf_event_task_sched_out
>                     |                     __schedule
>                     |                     preempt_schedule_common
>                     |                     _cond_resched
>                     |                     mutex_lock
>                     |                     n_tty_write
>                     |                     tty_write
>                     |                     __vfs_write
>                     |                     vfs_write
>                     |                     sys_write
>                     |                     entry_SYSCALL_64_fastpath
>                     |                     __GI___libc_write
>                     |                     0x1dbdc70
>                      --0.08%-- [...]
> 
>      4.28%     0.00%  ls       [kernel.vmlinux]    [k] mutex_lock                       
>                  |
>                  ---mutex_lock
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     |          
>                     |--20.42%-- 0
>                     |          
>                     |--18.66%-- 0x9096f2e61746164
>                     |          
>                     |--17.71%-- 0x909632e66666964
>                     |          
>                     |--14.47%-- 0x1dbdc70
>                      --28.74%-- [...]
> 
>      4.28%     0.00%  ls       [kernel.vmlinux]    [k] _cond_resched                    
>                  |
>                  ---_cond_resched
>                     mutex_lock
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     |          
>                     |--20.42%-- 0
>                     |          
>                     |--18.66%-- 0x9096f2e61746164
>                     |          
>                     |--17.71%-- 0x909632e66666964
>                     |          
>                     |--14.47%-- 0x1dbdc70
>                      --28.74%-- [...]
> 
>      4.28%     0.00%  ls       [kernel.vmlinux]    [k] preempt_schedule_common          
>                  |
>                  ---preempt_schedule_common
>                     _cond_resched
>                     mutex_lock
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     |          
>                     |--20.42%-- 0
>                     |          
>                     |--18.66%-- 0x9096f2e61746164
>                     |          
>                     |--17.71%-- 0x909632e66666964
>                     |          
>                     |--14.47%-- 0x1dbdc70
>                      --28.74%-- [...]
> 
>      4.06%     4.06%  ls       [kernel.vmlinux]    [k] io_serial_out                    
>                  |
>                  ---io_serial_out
>                     serial8250_console_putchar
>                     uart_console_write
>                     univ8250_console_write
>                     call_console_drivers.constprop.27
>                     console_unlock
>                     vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>      4.04%     4.04%  ls       ls                  [.] 0x0000000000006686               
>                  |
>                  ---0x6686
> 
>      4.04%     0.00%  ls       ls                  [.] 0xffffffffffc06686               
>                  |
>                  ---0x6686
> 
>      3.81%     0.00%  ls       [kernel.vmlinux]    [k] sys_getdents                     
>                  |
>                  ---sys_getdents
>                     entry_SYSCALL_64_fastpath
>                     __getdents64
> 
>      3.81%     0.00%  ls       [kernel.vmlinux]    [k] iterate_dir                      
>                  |
>                  ---iterate_dir
>                     sys_getdents
>                     entry_SYSCALL_64_fastpath
>                     __getdents64
> 
>      3.81%     0.00%  ls       [ext4]              [k] ext4_readdir                     
>                  |
>                  ---ext4_readdir
>                     iterate_dir
>                     sys_getdents
>                     entry_SYSCALL_64_fastpath
>                     __getdents64
> 
>      3.81%     0.00%  ls       [ext4]              [k] ext4_htree_fill_tree             
>                  |
>                  ---ext4_htree_fill_tree
>                     ext4_readdir
>                     iterate_dir
>                     sys_getdents
>                     entry_SYSCALL_64_fastpath
>                     __getdents64
> 
>      3.81%     0.00%  ls       [ext4]              [k] htree_dirblock_to_tree           
>                  |
>                  ---htree_dirblock_to_tree
>                     ext4_htree_fill_tree
>                     ext4_readdir
>                     iterate_dir
>                     sys_getdents
>                     entry_SYSCALL_64_fastpath
>                     __getdents64
> 
>      3.64%     0.00%  ls       [kernel.vmlinux]    [k] activate_task                    
>                  |
>                  ---activate_task
>                     ttwu_do_activate.constprop.92
>                     try_to_wake_up
>                     wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     |          
>                     |--56.57%-- tty_put_char
>                     |          do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          
>                     |--23.55%-- do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          
>                      --19.88%-- n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
>                                0x909632e66666964
> 
>      3.64%     0.00%  ls       [kernel.vmlinux]    [k] enqueue_task                     
>                  |
>                  ---enqueue_task
>                     activate_task
>                     ttwu_do_activate.constprop.92
>                     try_to_wake_up
>                     wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     |          
>                     |--56.57%-- tty_put_char
>                     |          do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          
>                     |--23.55%-- do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          
>                      --19.88%-- n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
>                                0x909632e66666964
> 
>      3.64%     0.00%  ls       [kernel.vmlinux]    [k] enqueue_task_fair                
>                  |
>                  ---enqueue_task_fair
>                     enqueue_task
>                     activate_task
>                     ttwu_do_activate.constprop.92
>                     try_to_wake_up
>                     wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     |          
>                     |--56.57%-- tty_put_char
>                     |          do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          
>                     |--23.55%-- do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          
>                      --19.88%-- n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
>                                0x909632e66666964
> 
>      3.38%     0.00%  ls       ld-2.18.so          [.] _dl_map_object                   
>                  |
>                  ---_dl_map_object
>                     |          
>                     |--45.27%-- 0x21eb10
>                     |          0
>                     |          
>                     |--45.27%-- 0x213988
>                     |          0
>                     |          
>                      --9.45%-- 0x21e640
>                                0
> 
>      3.27%     0.00%  ls       ld-2.18.so          [.] _dl_sysdep_start                 
>                  |
>                  ---_dl_sysdep_start
> 
>      3.27%     0.00%  ls       ld-2.18.so          [.] dl_main                          
>                  |
>                  ---dl_main
>                     _dl_sysdep_start
> 
>      3.08%     0.00%  ls       ld-2.18.so          [.] mmap64                           
>                  |
>                  ---mmap64
>                     |          
>                     |--50.39%-- _dl_check_all_versions
>                     |          
>                      --49.61%-- _dl_map_object
>                                0x213988
>                                0
> 
>      3.08%     0.00%  ls       [kernel.vmlinux]    [k] sys_mmap                         
>                  |
>                  ---sys_mmap
>                     entry_SYSCALL_64_fastpath
>                     mmap64
>                     |          
>                     |--50.39%-- _dl_check_all_versions
>                     |          
>                      --49.61%-- _dl_map_object
>                                0x213988
>                                0
> 
>      3.08%     0.00%  ls       [kernel.vmlinux]    [k] sys_mmap_pgoff                   
>                  |
>                  ---sys_mmap_pgoff
>                     sys_mmap
>                     entry_SYSCALL_64_fastpath
>                     mmap64
>                     |          
>                     |--50.39%-- _dl_check_all_versions
>                     |          
>                      --49.61%-- _dl_map_object
>                                0x213988
>                                0
> 
>      3.08%     0.00%  ls       [kernel.vmlinux]    [k] vm_mmap_pgoff                    
>                  |
>                  ---vm_mmap_pgoff
>                     sys_mmap_pgoff
>                     sys_mmap
>                     entry_SYSCALL_64_fastpath
>                     mmap64
>                     |          
>                     |--50.39%-- _dl_check_all_versions
>                     |          
>                      --49.61%-- _dl_map_object
>                                0x213988
>                                0
> 
>      3.08%     0.00%  ls       [kernel.vmlinux]    [k] do_mmap_pgoff                    
>                  |
>                  ---do_mmap_pgoff
>                     vm_mmap_pgoff
>                     sys_mmap_pgoff
>                     sys_mmap
>                     entry_SYSCALL_64_fastpath
>                     mmap64
>                     |          
>                     |--50.39%-- _dl_check_all_versions
>                     |          
>                      --49.61%-- _dl_map_object
>                                0x213988
>                                0
> 
>      3.08%     0.00%  ls       [kernel.vmlinux]    [k] mmap_region                      
>                  |
>                  ---mmap_region
>                     do_mmap_pgoff
>                     vm_mmap_pgoff
>                     sys_mmap_pgoff
>                     sys_mmap
>                     entry_SYSCALL_64_fastpath
>                     mmap64
>                     |          
>                     |--50.39%-- _dl_check_all_versions
>                     |          
>                      --49.61%-- _dl_map_object
>                                0x213988
>                                0
> 
>      3.03%     0.00%  ls       [kernel.vmlinux]    [k] mmput                            
>                  |
>                  ---mmput
>                     do_exit
>                     do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
> 
>      3.03%     0.00%  ls       [kernel.vmlinux]    [k] exit_mmap                        
>                  |
>                  ---exit_mmap
>                     mmput
>                     do_exit
>                     do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
> 
>      2.98%     0.00%  ls       [unknown]           [.] 0x657461746f6e6e61               
>                  |
>                  ---0x657461746f6e6e61
> 
>      2.79%     0.64%  ls       [kernel.vmlinux]    [k] finish_task_switch               
>                  |
>                  ---finish_task_switch
>                     __schedule
>                     preempt_schedule_common
>                     _cond_resched
>                     mutex_lock
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     |          
>                     |--28.65%-- 0x9096f2e61746164
>                     |          
>                     |--27.20%-- 0x909632e66666964
>                      --44.14%-- [...]
> 
>      2.70%     0.00%  ls       [kernel.vmlinux]    [k] int_ret_from_sys_call            
>                  |
>                  ---int_ret_from_sys_call
>                     __GI___libc_write
>                     |          
>                     |--43.71%-- 0x96f2e68636e6562
>                     |          
>                     |--34.69%-- 0x2d6469646c697562
>                     |          
>                      --21.61%-- 0x6f2e7473696c7665
> 
>      2.70%     0.00%  ls       [kernel.vmlinux]    [k] syscall_return_slowpath          
>                  |
>                  ---syscall_return_slowpath
>                     int_ret_from_sys_call
>                     __GI___libc_write
>                     |          
>                     |--43.71%-- 0x96f2e68636e6562
>                     |          
>                     |--34.69%-- 0x2d6469646c697562
>                     |          
>                      --21.61%-- 0x6f2e7473696c7665
> 
>      2.70%     1.18%  ls       [kernel.vmlinux]    [k] prepare_exit_to_usermode         
>                  |
>                  ---prepare_exit_to_usermode
>                     syscall_return_slowpath
>                     int_ret_from_sys_call
>                     __GI___libc_write
>                     |          
>                     |--43.71%-- 0x96f2e68636e6562
>                     |          
>                     |--34.69%-- 0x2d6469646c697562
>                     |          
>                      --21.61%-- 0x6f2e7473696c7665
> 
>      2.43%     0.00%  ls       [kernel.vmlinux]    [k] __perf_event_task_sched_out      
>                  |
>                  ---__perf_event_task_sched_out
>                     __schedule
>                     |          
>                     |--61.42%-- preempt_schedule_common
>                     |          _cond_resched
>                     |          mutex_lock
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |          |--58.52%-- 0
>                     |          |          
>                     |           --41.48%-- 0x1dbdc70
>                     |          
>                      --38.58%-- schedule
>                                prepare_exit_to_usermode
>                                syscall_return_slowpath
>                                int_ret_from_sys_call
>                                __GI___libc_write
>                                0x2d6469646c697562
> 
>      2.30%     0.00%  ls       ls                  [.] 0xffffffffffc06dcb               
>                  |
>                  ---0x6dcb
>                     0
>                     |          
>                     |--56.03%-- 0x632e74617473
>                     |          
>                      --43.97%-- 0x72616863656d6974
> 
>      2.26%     1.63%  ls       ld-2.18.so          [.] do_lookup_x                      
>                  |
>                  ---do_lookup_x
> 
>      2.16%     1.54%  ls       [kernel.vmlinux]    [k] nmi                              
>                  |
>                  ---nmi
>                     |          
>                     |--63.15%-- __const_udelay
>                     |          wait_for_xmitr
>                     |          serial8250_console_putchar
>                     |          uart_console_write
>                     |          univ8250_console_write
>                     |          call_console_drivers.constprop.27
>                     |          console_unlock
>                     |          vprintk_emit
>                     |          vprintk_default
>                     |          printk
>                     |          perf_duration_warn
>                     |          irq_work_run_list
>                     |          irq_work_run
>                     |          smp_irq_work_interrupt
>                     |          irq_work_interrupt
>                     |          __inode_permission
>                     |          inode_permission
>                     |          link_path_walk
>                     |          path_openat
>                     |          do_filp_open
>                     |          do_sys_open
>                     |          sys_open
>                     |          entry_SYSCALL_64_fastpath
>                     |          open64
>                     |          0x686361632e6f732e
>                     |          
>                     |--29.07%-- do_lookup_x
>                     |          
>                     |--5.52%-- end_repeat_nmi
>                     |          scheduler_tick
>                     |          update_process_times
>                     |          tick_sched_handle.isra.17
>                     |          tick_sched_timer
>                     |          __hrtimer_run_queues
>                     |          hrtimer_interrupt
>                     |          local_apic_timer_interrupt
>                     |          smp_apic_timer_interrupt
>                     |          apic_timer_interrupt
>                     |          setup_new_exec
>                     |          load_elf_binary
>                     |          search_binary_handler
>                     |          do_execveat_common.isra.32
>                     |          sys_execve
>                     |          return_from_execve
>                     |          0x7f9abb498a77
>                     |          
>                     |--1.10%-- nmi_handle
>                     |          default_do_nmi
>                     |          do_nmi
>                     |          end_repeat_nmi
>                     |          scheduler_tick
>                     |          update_process_times
>                     |          tick_sched_handle.isra.17
>                     |          tick_sched_timer
>                     |          __hrtimer_run_queues
>                     |          hrtimer_interrupt
>                     |          local_apic_timer_interrupt
>                     |          smp_apic_timer_interrupt
>                     |          apic_timer_interrupt
>                     |          setup_new_exec
>                     |          load_elf_binary
>                     |          search_binary_handler
>                     |          do_execveat_common.isra.32
>                     |          sys_execve
>                     |          return_from_execve
>                     |          0x7f9abb498a77
>                     |          
>                     |--0.63%-- perf_event_nmi_handler
>                     |          nmi_handle
>                     |          default_do_nmi
>                     |          do_nmi
>                     |          end_repeat_nmi
>                     |          scheduler_tick
>                     |          update_process_times
>                     |          tick_sched_handle.isra.17
>                     |          tick_sched_timer
>                     |          __hrtimer_run_queues
>                     |          hrtimer_interrupt
>                     |          local_apic_timer_interrupt
>                     |          smp_apic_timer_interrupt
>                     |          apic_timer_interrupt
>                     |          setup_new_exec
>                     |          load_elf_binary
>                     |          search_binary_handler
>                     |          do_execveat_common.isra.32
>                     |          sys_execve
>                     |          return_from_execve
>                     |          0x7f9abb498a77
>                     |          
>                      --0.52%-- scheduler_tick
>                                update_process_times
>                                tick_sched_handle.isra.17
>                                tick_sched_timer
>                                __hrtimer_run_queues
>                                hrtimer_interrupt
>                                local_apic_timer_interrupt
>                                smp_apic_timer_interrupt
>                                apic_timer_interrupt
>                                setup_new_exec
>                                load_elf_binary
>                                search_binary_handler
>                                do_execveat_common.isra.32
>                                sys_execve
>                                return_from_execve
>                                0x7f9abb498a77
> 
>      2.15%     0.00%  ls       [kernel.vmlinux]    [k] __perf_event_task_sched_in       
>                  |
>                  ---__perf_event_task_sched_in
>                     finish_task_switch
>                     __schedule
>                     preempt_schedule_common
>                     _cond_resched
>                     mutex_lock
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     |          
>                     |--37.19%-- 0x9096f2e61746164
>                     |          
>                     |--35.31%-- 0x909632e66666964
>                      --27.50%-- [...]
> 
>      2.06%     0.00%  ls       [kernel.vmlinux]    [k] tty_put_char                     
>                  |
>                  ---tty_put_char
>                     do_output_char
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
> 
>      2.06%     2.06%  ls       [kernel.vmlinux]    [k] update_rq_runnable_avg           
>                  |
>                  ---update_rq_runnable_avg
>                     enqueue_task_fair
>                     enqueue_task
>                     activate_task
>                     ttwu_do_activate.constprop.92
>                     try_to_wake_up
>                     wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     tty_put_char
>                     do_output_char
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
> 
>      1.98%     1.98%  ls       libc-2.18.so        [.] __strcoll_l                      
>                  |
>                  ---__strcoll_l
>                     0xe1cf
>                     0x841f0f
> 
>      1.97%     1.35%  ls       [kernel.vmlinux]    [k] perf_pmu_sched_task              
>                  |
>                  ---perf_pmu_sched_task
>                     |          
>                     |--68.52%-- __perf_event_task_sched_in
>                     |          finish_task_switch
>                     |          __schedule
>                     |          preempt_schedule_common
>                     |          _cond_resched
>                     |          mutex_lock
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          |          
>                     |           --100.00%-- 0x909632e66666964
>                     |          
>                      --31.48%-- __perf_event_task_sched_out
>                                __schedule
>                                preempt_schedule_common
>                                _cond_resched
>                                mutex_lock
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
>                                0x1dbdc70
> 
>      1.95%     1.95%  ls       ls                  [.] 0x000000000000e270               
>                  |
>                  ---0xe270
>                     0x841f0f
> 
>      1.95%     0.00%  ls       ls                  [.] 0xffffffffffc0e270               
>                  |
>                  ---0xe270
>                     0x841f0f
> 
>      1.94%     0.00%  ls       [unknown]           [.] 0x616863656d69742d               
>                  |
>                  ---0x616863656d69742d
> 
>      1.93%     0.00%  ls       [kernel.vmlinux]    [k] unmap_vmas                       
>                  |
>                  ---unmap_vmas
>                     exit_mmap
>                     mmput
>                     do_exit
>                     do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
> 
>      1.93%     0.93%  ls       [kernel.vmlinux]    [k] unmap_single_vma                 
>                  |
>                  ---unmap_single_vma
>                     unmap_vmas
>                     exit_mmap
>                     mmput
>                     do_exit
>                     do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
> 
>      1.93%     0.00%  ls       [ext4]              [k] ext4fs_dirhash                   
>                  |
>                  ---ext4fs_dirhash
>                     htree_dirblock_to_tree
>                     ext4_htree_fill_tree
>                     ext4_readdir
>                     iterate_dir
>                     sys_getdents
>                     entry_SYSCALL_64_fastpath
>                     __getdents64
> 
>      1.93%     1.93%  ls       [ext4]              [k] str2hashbuf_signed               
>                  |
>                  ---str2hashbuf_signed
>                     ext4fs_dirhash
>                     htree_dirblock_to_tree
>                     ext4_htree_fill_tree
>                     ext4_readdir
>                     iterate_dir
>                     sys_getdents
>                     entry_SYSCALL_64_fastpath
>                     __getdents64
> 
>      1.91%     0.00%  ls       [unknown]           [.] 0x6e69746c69756220               
>                  |
>                  ---0x6e69746c69756220
> 
>      1.91%     0.00%  ls       [kernel.vmlinux]    [k] ttwu_do_wakeup                   
>                  |
>                  ---ttwu_do_wakeup
>                     ttwu_do_activate.constprop.92
>                     try_to_wake_up
>                     wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     0x6e69746c69756220
> 
>      1.91%     0.00%  ls       [kernel.vmlinux]    [k] check_preempt_curr               
>                  |
>                  ---check_preempt_curr
>                     ttwu_do_wakeup
>                     ttwu_do_activate.constprop.92
>                     try_to_wake_up
>                     wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     0x6e69746c69756220
> 
>      1.91%     0.00%  ls       [kernel.vmlinux]    [k] check_preempt_wakeup             
>                  |
>                  ---check_preempt_wakeup
>                     check_preempt_curr
>                     ttwu_do_wakeup
>                     ttwu_do_activate.constprop.92
>                     try_to_wake_up
>                     wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     0x6e69746c69756220
> 
>      1.91%     1.91%  ls       [kernel.vmlinux]    [k] set_next_buddy                   
>                  |
>                  ---set_next_buddy
>                     check_preempt_wakeup
>                     check_preempt_curr
>                     ttwu_do_wakeup
>                     ttwu_do_activate.constprop.92
>                     try_to_wake_up
>                     wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     0x6e69746c69756220
> 
>      1.89%     1.89%  ls       [ext4]              [k] ext4_htree_store_dirent          
>                  |
>                  ---ext4_htree_store_dirent
>                     htree_dirblock_to_tree
>                     ext4_htree_fill_tree
>                     ext4_readdir
>                     iterate_dir
>                     sys_getdents
>                     entry_SYSCALL_64_fastpath
>                     __getdents64
> 
>      1.85%     1.85%  ls       libc-2.18.so        [.] __strcmp_sse2                    
>                  |
>                  ---__strcmp_sse2
> 
>      1.82%     0.00%  ls       [unknown]           [.] 0x6f74207367756220               
>                  |
>                  ---0x6f74207367756220
> 
>      1.82%     1.82%  ls       libc-2.18.so        [.] strlen                           
>                  |
>                  ---strlen
>                     0x6f74207367756220
> 
>      1.81%     0.00%  ls       [kernel.vmlinux]    [k] ctx_sched_out                    
>                  |
>                  ---ctx_sched_out
>                     __perf_event_task_sched_out
>                     __schedule
>                     |          
>                     |--51.77%-- schedule
>                     |          prepare_exit_to_usermode
>                     |          syscall_return_slowpath
>                     |          int_ret_from_sys_call
>                     |          __GI___libc_write
>                     |          0x2d6469646c697562
>                     |          
>                      --48.23%-- preempt_schedule_common
>                                _cond_resched
>                                mutex_lock
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
>                                0
> 
>      1.81%     0.00%  ls       [kernel.vmlinux]    [k] perf_pmu_disable                 
>                  |
>                  ---perf_pmu_disable
>                     ctx_sched_out
>                     __perf_event_task_sched_out
>                     __schedule
>                     |          
>                     |--51.77%-- schedule
>                     |          prepare_exit_to_usermode
>                     |          syscall_return_slowpath
>                     |          int_ret_from_sys_call
>                     |          __GI___libc_write
>                     |          0x2d6469646c697562
>                     |          
>                      --48.23%-- preempt_schedule_common
>                                _cond_resched
>                                mutex_lock
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
>                                0
> 
>      1.81%     0.00%  ls       [kernel.vmlinux]    [k] x86_pmu_disable                  
>                  |
>                  ---x86_pmu_disable
>                     perf_pmu_disable
>                     ctx_sched_out
>                     __perf_event_task_sched_out
>                     __schedule
>                     |          
>                     |--51.77%-- schedule
>                     |          prepare_exit_to_usermode
>                     |          syscall_return_slowpath
>                     |          int_ret_from_sys_call
>                     |          __GI___libc_write
>                     |          0x2d6469646c697562
>                     |          
>                      --48.23%-- preempt_schedule_common
>                                _cond_resched
>                                mutex_lock
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
>                                0
> 
>      1.81%     0.00%  ls       [kernel.vmlinux]    [k] intel_pmu_disable_all            
>                  |
>                  ---intel_pmu_disable_all
>                     x86_pmu_disable
>                     perf_pmu_disable
>                     ctx_sched_out
>                     __perf_event_task_sched_out
>                     __schedule
>                     |          
>                     |--51.77%-- schedule
>                     |          prepare_exit_to_usermode
>                     |          syscall_return_slowpath
>                     |          int_ret_from_sys_call
>                     |          __GI___libc_write
>                     |          0x2d6469646c697562
>                     |          
>                      --48.23%-- preempt_schedule_common
>                                _cond_resched
>                                mutex_lock
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
>                                0
> 
>      1.81%     0.00%  ls       [kernel.vmlinux]    [k] __intel_pmu_disable_all          
>                  |
>                  ---__intel_pmu_disable_all
>                     intel_pmu_disable_all
>                     x86_pmu_disable
>                     perf_pmu_disable
>                     ctx_sched_out
>                     __perf_event_task_sched_out
>                     __schedule
>                     |          
>                     |--51.77%-- schedule
>                     |          prepare_exit_to_usermode
>                     |          syscall_return_slowpath
>                     |          int_ret_from_sys_call
>                     |          __GI___libc_write
>                     |          0x2d6469646c697562
>                     |          
>                      --48.23%-- preempt_schedule_common
>                                _cond_resched
>                                mutex_lock
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
>                                0
> 
>      1.76%     0.00%  ls       [unknown]           [.] 0x00401f0fc3f30678               
>                  |
>                  ---0x401f0fc3f30678
> 
>      1.76%     1.76%  ls       libc-2.18.so        [.] _dl_addr                         
>                  |
>                  ---_dl_addr
>                     0x401f0fc3f30678
> 
>      1.72%     0.00%  ls       ls                  [.] 0xffffffffffc06438               
>                  |
>                  ---0x6438
> 
>      1.72%     1.72%  ls       ls                  [.] 0x0000000000005b4d               
>                  |
>                  ---0x5b4d
>                     0x6438
> 
>      1.72%     0.00%  ls       ls                  [.] 0xffffffffffc05b4d               
>                  |
>                  ---0x5b4d
>                     0x6438
> 
>      1.70%     1.70%  ls       libpthread-2.18.so  [.] frame_dummy                      
>                  |
>                  ---frame_dummy
> 
>      1.68%     0.00%  ls       ld-2.18.so          [.] mprotect                         
>                  |
>                  ---mprotect
>                     dl_main
>                     _dl_sysdep_start
> 
>      1.68%     0.00%  ls       [kernel.vmlinux]    [k] sys_mprotect                     
>                  |
>                  ---sys_mprotect
>                     entry_SYSCALL_64_fastpath
>                     mprotect
>                     dl_main
>                     _dl_sysdep_start
> 
>      1.68%     0.00%  ls       [kernel.vmlinux]    [k] mprotect_fixup                   
>                  |
>                  ---mprotect_fixup
>                     sys_mprotect
>                     entry_SYSCALL_64_fastpath
>                     mprotect
>                     dl_main
>                     _dl_sysdep_start
> 
>      1.68%     0.00%  ls       [kernel.vmlinux]    [k] split_vma                        
>                  |
>                  ---split_vma
>                     mprotect_fixup
>                     sys_mprotect
>                     entry_SYSCALL_64_fastpath
>                     mprotect
>                     dl_main
>                     _dl_sysdep_start
> 
>      1.68%     0.00%  ls       [kernel.vmlinux]    [k] __split_vma.isra.34              
>                  |
>                  ---__split_vma.isra.34
>                     split_vma
>                     mprotect_fixup
>                     sys_mprotect
>                     entry_SYSCALL_64_fastpath
>                     mprotect
>                     dl_main
>                     _dl_sysdep_start
> 
>      1.68%     1.68%  ls       [kernel.vmlinux]    [k] vma_interval_tree_remove         
>                  |
>                  ---vma_interval_tree_remove
>                     __split_vma.isra.34
>                     split_vma
>                     mprotect_fixup
>                     sys_mprotect
>                     entry_SYSCALL_64_fastpath
>                     mprotect
>                     dl_main
>                     _dl_sysdep_start
> 
>      1.59%     1.59%  ls       ld-2.18.so          [.] _dl_relocate_object              
>                  |
>                  ---_dl_relocate_object
>                     dl_main
>                     _dl_sysdep_start
> 
>      1.58%     0.86%  ls       [kernel.vmlinux]    [k] enqueue_entity                   
>                  |
>                  ---enqueue_entity
>                     enqueue_task_fair
>                     enqueue_task
>                     activate_task
>                     ttwu_do_activate.constprop.92
>                     try_to_wake_up
>                     wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     |          
>                     |--54.22%-- do_output_char
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          
>                      --45.78%-- n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
>                                0x909632e66666964
> 
>      1.55%     0.00%  ls       ld-2.18.so          [.] _dl_check_all_versions           
>                  |
>                  ---_dl_check_all_versions
> 
>      1.55%     0.00%  ls       [kernel.vmlinux]    [k] perf_event_mmap                  
>                  |
>                  ---perf_event_mmap
>                     mmap_region
>                     do_mmap_pgoff
>                     vm_mmap_pgoff
>                     sys_mmap_pgoff
>                     sys_mmap
>                     entry_SYSCALL_64_fastpath
>                     mmap64
>                     _dl_check_all_versions
> 
>      1.55%     0.00%  ls       [kernel.vmlinux]    [k] perf_event_aux                   
>                  |
>                  ---perf_event_aux
>                     perf_event_mmap
>                     mmap_region
>                     do_mmap_pgoff
>                     vm_mmap_pgoff
>                     sys_mmap_pgoff
>                     sys_mmap
>                     entry_SYSCALL_64_fastpath
>                     mmap64
>                     _dl_check_all_versions
> 
>      1.55%     1.55%  ls       [kernel.vmlinux]    [k] perf_event_aux_ctx               
>                  |
>                  ---perf_event_aux_ctx
>                     perf_event_aux
>                     perf_event_mmap
>                     mmap_region
>                     do_mmap_pgoff
>                     vm_mmap_pgoff
>                     sys_mmap_pgoff
>                     sys_mmap
>                     entry_SYSCALL_64_fastpath
>                     mmap64
>                     _dl_check_all_versions
> 
>      1.53%     0.00%  ls       ld-2.18.so          [.] 0xffff804cabb57988               
>                  |
>                  ---0x213988
>                     0
> 
>      1.53%     0.00%  ls       ld-2.18.so          [.] 0xffff804cabb62b10               
>                  |
>                  ---0x21eb10
>                     0
> 
>      1.53%     0.00%  ls       ld-2.18.so          [.] memset                           
>                  |
>                  ---memset
>                     _dl_map_object
>                     0x21eb10
>                     0
> 
>      1.53%     0.00%  ls       [kernel.vmlinux]    [k] page_fault                       
>                  |
>                  ---page_fault
>                     memset
>                     _dl_map_object
>                     0x21eb10
>                     0
> 
>      1.53%     0.00%  ls       [kernel.vmlinux]    [k] do_page_fault                    
>                  |
>                  ---do_page_fault
>                     page_fault
>                     memset
>                     _dl_map_object
>                     0x21eb10
>                     0
> 
>      1.53%     0.00%  ls       [kernel.vmlinux]    [k] __do_page_fault                  
>                  |
>                  ---__do_page_fault
>                     do_page_fault
>                     page_fault
>                     memset
>                     _dl_map_object
>                     0x21eb10
>                     0
> 
>      1.53%     0.00%  ls       [kernel.vmlinux]    [k] handle_mm_fault                  
>                  |
>                  ---handle_mm_fault
>                     __do_page_fault
>                     do_page_fault
>                     page_fault
>                     memset
>                     _dl_map_object
>                     0x21eb10
>                     0
> 
>      1.53%     1.53%  ls       [kernel.vmlinux]    [k] put_page                         
>                  |
>                  ---put_page
>                     handle_mm_fault
>                     __do_page_fault
>                     do_page_fault
>                     page_fault
>                     memset
>                     _dl_map_object
>                     0x21eb10
>                     0
> 
>      1.53%     0.00%  ls       [kernel.vmlinux]    [k] vma_link                         
>                  |
>                  ---vma_link
>                     mmap_region
>                     do_mmap_pgoff
>                     vm_mmap_pgoff
>                     sys_mmap_pgoff
>                     sys_mmap
>                     entry_SYSCALL_64_fastpath
>                     mmap64
>                     _dl_map_object
>                     0x213988
>                     0
> 
>      1.53%     1.53%  ls       [kernel.vmlinux]    [k] vma_interval_tree_insert         
>                  |
>                  ---vma_interval_tree_insert
>                     vma_link
>                     mmap_region
>                     do_mmap_pgoff
>                     vm_mmap_pgoff
>                     sys_mmap_pgoff
>                     sys_mmap
>                     entry_SYSCALL_64_fastpath
>                     mmap64
>                     _dl_map_object
>                     0x213988
>                     0
> 
>      1.52%     0.00%  ls       [kernel.vmlinux]    [k] schedule                         
>                  |
>                  ---schedule
>                     prepare_exit_to_usermode
>                     syscall_return_slowpath
>                     int_ret_from_sys_call
>                     __GI___libc_write
>                     |          
>                     |--61.62%-- 0x2d6469646c697562
>                     |          
>                      --38.38%-- 0x6f2e7473696c7665
> 
>      1.48%     0.00%  ls       [unknown]           [.] 0x0909632e66666964               
>                  |
>                  ---0x909632e66666964
> 
>      1.44%     1.44%  ls       [kernel.vmlinux]    [k] paranoid_entry                   
>                  |
>                  ---paranoid_entry
>                     __const_udelay
>                     wait_for_xmitr
>                     serial8250_console_putchar
>                     uart_console_write
>                     univ8250_console_write
>                     call_console_drivers.constprop.27
>                     console_unlock
>                     vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>      1.42%     0.00%  ls       [kernel.vmlinux]    [k] perf_pmu_enable                  
>                  |
>                  ---perf_pmu_enable
>                     |          
>                     |--56.32%-- perf_event_context_sched_in
>                     |          |          
>                     |          |--100.00%-- __perf_event_task_sched_in
>                     |          |          finish_task_switch
>                     |          |          __schedule
>                     |          |          preempt_schedule_common
>                     |          |          _cond_resched
>                     |          |          mutex_lock
>                     |          |          n_tty_write
>                     |          |          tty_write
>                     |          |          __vfs_write
>                     |          |          vfs_write
>                     |          |          sys_write
>                     |          |          entry_SYSCALL_64_fastpath
>                     |          |          __GI___libc_write
>                     |          |          0x9096f2e61746164
>                     |           --0.00%-- [...]
>                     |          
>                      --43.68%-- perf_pmu_sched_task
>                                __perf_event_task_sched_out
>                                __schedule
>                                preempt_schedule_common
>                                _cond_resched
>                                mutex_lock
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
>                                0x1dbdc70
> 
>      1.42%     0.00%  ls       [kernel.vmlinux]    [k] x86_pmu_enable                   
>                  |
>                  ---x86_pmu_enable
>                     perf_pmu_enable
>                     |          
>                     |--56.32%-- perf_event_context_sched_in
>                     |          |          
>                     |          |--100.00%-- __perf_event_task_sched_in
>                     |          |          finish_task_switch
>                     |          |          __schedule
>                     |          |          preempt_schedule_common
>                     |          |          _cond_resched
>                     |          |          mutex_lock
>                     |          |          n_tty_write
>                     |          |          tty_write
>                     |          |          __vfs_write
>                     |          |          vfs_write
>                     |          |          sys_write
>                     |          |          entry_SYSCALL_64_fastpath
>                     |          |          __GI___libc_write
>                     |          |          0x9096f2e61746164
>                     |           --0.00%-- [...]
>                     |          
>                      --43.68%-- perf_pmu_sched_task
>                                __perf_event_task_sched_out
>                                __schedule
>                                preempt_schedule_common
>                                _cond_resched
>                                mutex_lock
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
>                                0x1dbdc70
> 
>      1.42%     0.00%  ls       [kernel.vmlinux]    [k] intel_pmu_enable_all             
>                  |
>                  ---intel_pmu_enable_all
>                     x86_pmu_enable
>                     perf_pmu_enable
>                     |          
>                     |--56.32%-- perf_event_context_sched_in
>                     |          |          
>                     |          |--100.00%-- __perf_event_task_sched_in
>                     |          |          finish_task_switch
>                     |          |          __schedule
>                     |          |          preempt_schedule_common
>                     |          |          _cond_resched
>                     |          |          mutex_lock
>                     |          |          n_tty_write
>                     |          |          tty_write
>                     |          |          __vfs_write
>                     |          |          vfs_write
>                     |          |          sys_write
>                     |          |          entry_SYSCALL_64_fastpath
>                     |          |          __GI___libc_write
>                     |          |          0x9096f2e61746164
>                     |           --0.00%-- [...]
>                     |          
>                      --43.68%-- perf_pmu_sched_task
>                                __perf_event_task_sched_out
>                                __schedule
>                                preempt_schedule_common
>                                _cond_resched
>                                mutex_lock
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
>                                0x1dbdc70
> 
>      1.42%     0.00%  ls       [kernel.vmlinux]    [k] __intel_pmu_enable_all.isra.9    
>                  |
>                  ---__intel_pmu_enable_all.isra.9
>                     intel_pmu_enable_all
>                     x86_pmu_enable
>                     perf_pmu_enable
>                     |          
>                     |--56.32%-- perf_event_context_sched_in
>                     |          |          
>                     |          |--100.00%-- __perf_event_task_sched_in
>                     |          |          finish_task_switch
>                     |          |          __schedule
>                     |          |          preempt_schedule_common
>                     |          |          _cond_resched
>                     |          |          mutex_lock
>                     |          |          n_tty_write
>                     |          |          tty_write
>                     |          |          __vfs_write
>                     |          |          vfs_write
>                     |          |          sys_write
>                     |          |          entry_SYSCALL_64_fastpath
>                     |          |          __GI___libc_write
>                     |          |          0x9096f2e61746164
>                     |           --0.00%-- [...]
>                     |          
>                      --43.68%-- perf_pmu_sched_task
>                                __perf_event_task_sched_out
>                                __schedule
>                                preempt_schedule_common
>                                _cond_resched
>                                mutex_lock
>                                n_tty_write
>                                tty_write
>                                __vfs_write
>                                vfs_write
>                                sys_write
>                                entry_SYSCALL_64_fastpath
>                                __GI___libc_write
>                                0x1dbdc70
> 
>      1.42%     0.00%  ls       [kernel.vmlinux]    [k] wq_worker_waking_up              
>                  |
>                  ---wq_worker_waking_up
>                     ttwu_do_activate.constprop.92
>                     try_to_wake_up
>                     wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     do_output_char
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     0x657461746f6e6e61
> 
>      1.42%     1.42%  ls       [kernel.vmlinux]    [k] kthread_data                     
>                  |
>                  ---kthread_data
>                     wq_worker_waking_up
>                     ttwu_do_activate.constprop.92
>                     try_to_wake_up
>                     wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     do_output_char
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     0x657461746f6e6e61
> 
>      1.31%     0.04%  ls       [kernel.vmlinux]    [k] do_nmi                           
>                  |
>                  ---do_nmi
>                     |          
>                     |--52.08%-- end_repeat_nmi
>                     |          |          
>                     |          |--46.71%-- vsnprintf
>                     |          |          sprintf
>                     |          |          print_time.part.12
>                     |          |          print_prefix
>                     |          |          msg_print_text
>                     |          |          console_unlock
>                     |          |          vprintk_emit
>                     |          |          vprintk_default
>                     |          |          printk
>                     |          |          perf_duration_warn
>                     |          |          irq_work_run_list
>                     |          |          irq_work_run
>                     |          |          smp_irq_work_interrupt
>                     |          |          irq_work_interrupt
>                     |          |          __inode_permission
>                     |          |          inode_permission
>                     |          |          link_path_walk
>                     |          |          path_openat
>                     |          |          do_filp_open
>                     |          |          do_sys_open
>                     |          |          sys_open
>                     |          |          entry_SYSCALL_64_fastpath
>                     |          |          open64
>                     |          |          0x686361632e6f732e
>                     |          |          
>                     |          |--41.63%-- __inode_permission
>                     |          |          inode_permission
>                     |          |          link_path_walk
>                     |          |          path_openat
>                     |          |          do_filp_open
>                     |          |          do_sys_open
>                     |          |          sys_open
>                     |          |          entry_SYSCALL_64_fastpath
>                     |          |          open64
>                     |          |          0x686361632e6f732e
>                     |          |          
>                     |           --11.66%-- scheduler_tick
>                     |                     update_process_times
>                     |                     tick_sched_handle.isra.17
>                     |                     tick_sched_timer
>                     |                     __hrtimer_run_queues
>                     |                     hrtimer_interrupt
>                     |                     local_apic_timer_interrupt
>                     |                     smp_apic_timer_interrupt
>                     |                     apic_timer_interrupt
>                     |                     setup_new_exec
>                     |                     load_elf_binary
>                     |                     search_binary_handler
>                     |                     do_execveat_common.isra.32
>                     |                     sys_execve
>                     |                     return_from_execve
>                     |                     0x7f9abb498a77
>                     |          
>                      --47.92%-- nmi
>                                do_lookup_x
> 
>      1.29%     0.00%  ls       [unknown]           [.] 0x0000632e74617473               
>                  |
>                  ---0x632e74617473
> 
>      1.29%     1.29%  ls       ls                  [.] 0x0000000000005a40               
>                  |
>                  ---0x5a40
>                     0x6dcb
>                     0
>                     0x632e74617473
> 
>      1.29%     0.00%  ls       ls                  [.] 0xffffffffffc05a40               
>                  |
>                  ---0x5a40
>                     0x6dcb
>                     0
>                     0x632e74617473
> 
>      1.27%     0.00%  ls       [kernel.vmlinux]    [k] default_do_nmi                   
>                  |
>                  ---default_do_nmi
>                     do_nmi
>                     |          
>                     |--50.48%-- end_repeat_nmi
>                     |          |          
>                     |          |--49.78%-- vsnprintf
>                     |          |          sprintf
>                     |          |          print_time.part.12
>                     |          |          print_prefix
>                     |          |          msg_print_text
>                     |          |          console_unlock
>                     |          |          vprintk_emit
>                     |          |          vprintk_default
>                     |          |          printk
>                     |          |          perf_duration_warn
>                     |          |          irq_work_run_list
>                     |          |          irq_work_run
>                     |          |          smp_irq_work_interrupt
>                     |          |          irq_work_interrupt
>                     |          |          __inode_permission
>                     |          |          inode_permission
>                     |          |          link_path_walk
>                     |          |          path_openat
>                     |          |          do_filp_open
>                     |          |          do_sys_open
>                     |          |          sys_open
>                     |          |          entry_SYSCALL_64_fastpath
>                     |          |          open64
>                     |          |          0x686361632e6f732e
>                     |          |          
>                     |          |--44.37%-- __inode_permission
>                     |          |          inode_permission
>                     |          |          link_path_walk
>                     |          |          path_openat
>                     |          |          do_filp_open
>                     |          |          do_sys_open
>                     |          |          sys_open
>                     |          |          entry_SYSCALL_64_fastpath
>                     |          |          open64
>                     |          |          0x686361632e6f732e
>                     |          |          
>                     |           --5.85%-- scheduler_tick
>                     |                     update_process_times
>                     |                     tick_sched_handle.isra.17
>                     |                     tick_sched_timer
>                     |                     __hrtimer_run_queues
>                     |                     hrtimer_interrupt
>                     |                     local_apic_timer_interrupt
>                     |                     smp_apic_timer_interrupt
>                     |                     apic_timer_interrupt
>                     |                     setup_new_exec
>                     |                     load_elf_binary
>                     |                     search_binary_handler
>                     |                     do_execveat_common.isra.32
>                     |                     sys_execve
>                     |                     return_from_execve
>                     |                     0x7f9abb498a77
>                     |          
>                      --49.52%-- nmi
>                                do_lookup_x
> 
>      1.27%     0.63%  ls       [kernel.vmlinux]    [k] nmi_handle                       
>                  |
>                  ---nmi_handle
>                     default_do_nmi
>                     do_nmi
>                     |          
>                     |--50.48%-- end_repeat_nmi
>                     |          |          
>                     |          |--49.78%-- vsnprintf
>                     |          |          sprintf
>                     |          |          print_time.part.12
>                     |          |          print_prefix
>                     |          |          msg_print_text
>                     |          |          console_unlock
>                     |          |          vprintk_emit
>                     |          |          vprintk_default
>                     |          |          printk
>                     |          |          perf_duration_warn
>                     |          |          irq_work_run_list
>                     |          |          irq_work_run
>                     |          |          smp_irq_work_interrupt
>                     |          |          irq_work_interrupt
>                     |          |          __inode_permission
>                     |          |          inode_permission
>                     |          |          link_path_walk
>                     |          |          path_openat
>                     |          |          do_filp_open
>                     |          |          do_sys_open
>                     |          |          sys_open
>                     |          |          entry_SYSCALL_64_fastpath
>                     |          |          open64
>                     |          |          0x686361632e6f732e
>                     |          |          
>                     |          |--44.37%-- __inode_permission
>                     |          |          inode_permission
>                     |          |          link_path_walk
>                     |          |          path_openat
>                     |          |          do_filp_open
>                     |          |          do_sys_open
>                     |          |          sys_open
>                     |          |          entry_SYSCALL_64_fastpath
>                     |          |          open64
>                     |          |          0x686361632e6f732e
>                     |          |          
>                     |           --5.85%-- scheduler_tick
>                     |                     update_process_times
>                     |                     tick_sched_handle.isra.17
>                     |                     tick_sched_timer
>                     |                     __hrtimer_run_queues
>                     |                     hrtimer_interrupt
>                     |                     local_apic_timer_interrupt
>                     |                     smp_apic_timer_interrupt
>                     |                     apic_timer_interrupt
>                     |                     setup_new_exec
>                     |                     load_elf_binary
>                     |                     search_binary_handler
>                     |                     do_execveat_common.isra.32
>                     |                     sys_execve
>                     |                     return_from_execve
>                     |                     0x7f9abb498a77
>                     |          
>                      --49.52%-- nmi
>                                do_lookup_x
> 
>      1.24%     0.00%  ls       [unknown]           [.] 0x0000000001dbdc70               
>                  |
>                  ---0x1dbdc70
> 
>      1.23%     0.00%  ls       [kernel.vmlinux]    [k] task_work_run                    
>                  |
>                  ---task_work_run
>                     do_exit
>                     do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
> 
>      1.23%     0.00%  ls       [kernel.vmlinux]    [k] ____fput                         
>                  |
>                  ---____fput
>                     task_work_run
>                     do_exit
>                     do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
> 
>      1.23%     0.00%  ls       [kernel.vmlinux]    [k] __fput                           
>                  |
>                  ---__fput
>                     ____fput
>                     task_work_run
>                     do_exit
>                     do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
> 
>      1.23%     1.23%  ls       [kernel.vmlinux]    [k] locks_remove_file                
>                  |
>                  ---locks_remove_file
>                     __fput
>                     ____fput
>                     task_work_run
>                     do_exit
>                     do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
> 
>      1.18%     0.00%  ls       [unknown]           [.] 0x096f2e68636e6562               
>                  |
>                  ---0x96f2e68636e6562
> 
>      1.10%     0.00%  ls       [kernel.vmlinux]    [k] tlb_finish_mmu                   
>                  |
>                  ---tlb_finish_mmu
>                     exit_mmap
>                     mmput
>                     do_exit
>                     do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
> 
>      1.10%     0.00%  ls       [kernel.vmlinux]    [k] tlb_flush_mmu_free               
>                  |
>                  ---tlb_flush_mmu_free
>                     tlb_finish_mmu
>                     exit_mmap
>                     mmput
>                     do_exit
>                     do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
> 
>      1.10%     0.00%  ls       [kernel.vmlinux]    [k] free_pages_and_swap_cache        
>                  |
>                  ---free_pages_and_swap_cache
>                     tlb_flush_mmu_free
>                     tlb_finish_mmu
>                     exit_mmap
>                     mmput
>                     do_exit
>                     do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
> 
>      1.10%     1.10%  ls       [kernel.vmlinux]    [k] release_pages                    
>                  |
>                  ---release_pages
>                     free_pages_and_swap_cache
>                     tlb_flush_mmu_free
>                     tlb_finish_mmu
>                     exit_mmap
>                     mmput
>                     do_exit
>                     do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
> 
>      1.08%     1.08%  ls       ls                  [.] 0x0000000000006b20               
>                  |
>                  ---0x6b20
>                     0
>                     0
> 
>      1.08%     0.00%  ls       ls                  [.] 0xffffffffffc06b20               
>                  |
>                  ---0x6b20
>                     0
>                     0
> 
>      1.01%     0.00%  ls       [unknown]           [.] 0x72616863656d6974               
>                  |
>                  ---0x72616863656d6974
> 
>      1.01%     1.01%  ls       ls                  [.] __ctype_get_mb_cur_max@plt       
>                  |
>                  ---__ctype_get_mb_cur_max@plt
>                     0x6dcb
>                     0
>                     0x72616863656d6974
> 
>      1.01%     1.01%  ls       [kernel.vmlinux]    [k] unmap_page_range                 
>                  |
>                  ---unmap_page_range
>                     unmap_single_vma
>                     unmap_vmas
>                     exit_mmap
>                     mmput
>                     do_exit
>                     do_group_exit
>                     0x27cb44
>                     entry_SYSCALL_64_fastpath
> 
>      0.94%     0.00%  ls       [unknown]           [.] 0x2d6469646c697562               
>                  |
>                  ---0x2d6469646c697562
> 
>      0.89%     0.89%  ls       [kernel.vmlinux]    [k] get_pwq.isra.18                  
>                  |
>                  ---get_pwq.isra.18
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
> 
>      0.80%     0.00%  ls       [kernel.vmlinux]    [k] end_repeat_nmi                   
>                  |
>                  ---end_repeat_nmi
>                     |          
>                     |--39.76%-- vsnprintf
>                     |          sprintf
>                     |          print_time.part.12
>                     |          print_prefix
>                     |          msg_print_text
>                     |          console_unlock
>                     |          vprintk_emit
>                     |          vprintk_default
>                     |          printk
>                     |          perf_duration_warn
>                     |          irq_work_run_list
>                     |          irq_work_run
>                     |          smp_irq_work_interrupt
>                     |          irq_work_interrupt
>                     |          __inode_permission
>                     |          inode_permission
>                     |          link_path_walk
>                     |          path_openat
>                     |          do_filp_open
>                     |          do_sys_open
>                     |          sys_open
>                     |          entry_SYSCALL_64_fastpath
>                     |          open64
>                     |          0x686361632e6f732e
>                     |          
>                     |--35.44%-- __inode_permission
>                     |          inode_permission
>                     |          link_path_walk
>                     |          path_openat
>                     |          do_filp_open
>                     |          do_sys_open
>                     |          sys_open
>                     |          entry_SYSCALL_64_fastpath
>                     |          open64
>                     |          0x686361632e6f732e
>                     |          
>                      --24.80%-- scheduler_tick
>                                update_process_times
>                                tick_sched_handle.isra.17
>                                tick_sched_timer
>                                __hrtimer_run_queues
>                                hrtimer_interrupt
>                                local_apic_timer_interrupt
>                                smp_apic_timer_interrupt
>                                apic_timer_interrupt
>                                setup_new_exec
>                                load_elf_binary
>                                search_binary_handler
>                                do_execveat_common.isra.32
>                                sys_execve
>                                return_from_execve
>                                0x7f9abb498a77
> 
>      0.80%     0.00%  ls       [kernel.vmlinux]    [k] perf_event_context_sched_in      
>                  |
>                  ---perf_event_context_sched_in
>                     |          
>                     |--100.00%-- __perf_event_task_sched_in
>                     |          finish_task_switch
>                     |          __schedule
>                     |          preempt_schedule_common
>                     |          _cond_resched
>                     |          mutex_lock
>                     |          n_tty_write
>                     |          tty_write
>                     |          __vfs_write
>                     |          vfs_write
>                     |          sys_write
>                     |          entry_SYSCALL_64_fastpath
>                     |          __GI___libc_write
>                     |          0x9096f2e61746164
>                      --0.00%-- [...]
> 
>      0.80%     0.00%  ls       [unknown]           [.] 0x09096f2e61746164               
>                  |
>                  ---0x9096f2e61746164
> 
>      0.78%     0.00%  ls       libc-2.18.so        [.] __run_exit_handlers              
>                  |
>                  ---__run_exit_handlers
>                     0
> 
>      0.78%     0.00%  ls       libc-2.18.so        [.] _exit                            
>                  |
>                  ---_exit
>                     __run_exit_handlers
>                     0
> 
>      0.72%     0.72%  ls       [kernel.vmlinux]    [k] account_entity_enqueue           
>                  |
>                  ---account_entity_enqueue
>                     enqueue_entity
>                     enqueue_task_fair
>                     enqueue_task
>                     activate_task
>                     ttwu_do_activate.constprop.92
>                     try_to_wake_up
>                     wake_up_process
>                     wake_up_worker
>                     insert_work
>                     __queue_work
>                     queue_work_on
>                     tty_schedule_flip
>                     tty_flip_buffer_push
>                     pty_write
>                     n_tty_write
>                     tty_write
>                     __vfs_write
>                     vfs_write
>                     sys_write
>                     entry_SYSCALL_64_fastpath
>                     __GI___libc_write
>                     0x909632e66666964
> 
>      0.62%     0.00%  ls       [kernel.vmlinux]    [k] perf_event_nmi_handler           
>                  |
>                  ---perf_event_nmi_handler
>                     nmi_handle
>                     default_do_nmi
>                     do_nmi
>                     end_repeat_nmi
>                     |          
>                     |--51.70%-- vsnprintf
>                     |          sprintf
>                     |          print_time.part.12
>                     |          print_prefix
>                     |          msg_print_text
>                     |          console_unlock
>                     |          vprintk_emit
>                     |          vprintk_default
>                     |          printk
>                     |          perf_duration_warn
>                     |          irq_work_run_list
>                     |          irq_work_run
>                     |          smp_irq_work_interrupt
>                     |          irq_work_interrupt
>                     |          __inode_permission
>                     |          inode_permission
>                     |          link_path_walk
>                     |          path_openat
>                     |          do_filp_open
>                     |          do_sys_open
>                     |          sys_open
>                     |          entry_SYSCALL_64_fastpath
>                     |          open64
>                     |          0x686361632e6f732e
>                     |          
>                     |--46.08%-- __inode_permission
>                     |          inode_permission
>                     |          link_path_walk
>                     |          path_openat
>                     |          do_filp_open
>                     |          do_sys_open
>                     |          sys_open
>                     |          entry_SYSCALL_64_fastpath
>                     |          open64
>                     |          0x686361632e6f732e
>                     |          
>                      --2.22%-- scheduler_tick
>                                update_process_times
>                                tick_sched_handle.isra.17
>                                tick_sched_timer
>                                __hrtimer_run_queues
>                                hrtimer_interrupt
>                                local_apic_timer_interrupt
>                                smp_apic_timer_interrupt
>                                apic_timer_interrupt
>                                setup_new_exec
>                                load_elf_binary
>                                search_binary_handler
>                                do_execveat_common.isra.32
>                                sys_execve
>                                return_from_execve
>                                0x7f9abb498a77
> 
>      0.60%     0.60%  ls       [kernel.vmlinux]    [k] perf_sample_event_took           
>                  |
>                  ---perf_sample_event_took
>                     perf_event_nmi_handler
>                     nmi_handle
>                     default_do_nmi
>                     do_nmi
>                     end_repeat_nmi
>                     |          
>                     |--52.87%-- vsnprintf
>                     |          sprintf
>                     |          print_time.part.12
>                     |          print_prefix
>                     |          msg_print_text
>                     |          console_unlock
>                     |          vprintk_emit
>                     |          vprintk_default
>                     |          printk
>                     |          perf_duration_warn
>                     |          irq_work_run_list
>                     |          irq_work_run
>                     |          smp_irq_work_interrupt
>                     |          irq_work_interrupt
>                     |          __inode_permission
>                     |          inode_permission
>                     |          link_path_walk
>                     |          path_openat
>                     |          do_filp_open
>                     |          do_sys_open
>                     |          sys_open
>                     |          entry_SYSCALL_64_fastpath
>                     |          open64
>                     |          0x686361632e6f732e
>                     |          
>                      --47.13%-- __inode_permission
>                                inode_permission
>                                link_path_walk
>                                path_openat
>                                do_filp_open
>                                do_sys_open
>                                sys_open
>                                entry_SYSCALL_64_fastpath
>                                open64
>                                0x686361632e6f732e
> 
>      0.58%     0.00%  ls       [unknown]           [.] 0x6f2e7473696c7665               
>                  |
>                  ---0x6f2e7473696c7665
> 
>      0.58%     0.00%  ls       [kernel.vmlinux]    [k] pick_next_task_fair              
>                  |
>                  ---pick_next_task_fair
>                     __schedule
>                     schedule
>                     prepare_exit_to_usermode
>                     syscall_return_slowpath
>                     int_ret_from_sys_call
>                     __GI___libc_write
>                     0x6f2e7473696c7665
> 
>      0.58%     0.58%  ls       [kernel.vmlinux]    [k] __enqueue_entity                 
>                  |
>                  ---__enqueue_entity
>                     pick_next_task_fair
>                     __schedule
>                     schedule
>                     prepare_exit_to_usermode
>                     syscall_return_slowpath
>                     int_ret_from_sys_call
>                     __GI___libc_write
>                     0x6f2e7473696c7665
> 
>      0.57%     0.00%  ls       libc-2.18.so        [.] __GI___munmap                    
>                  |
>                  ---__GI___munmap
> 
>      0.57%     0.00%  ls       [kernel.vmlinux]    [k] sys_munmap                       
>                  |
>                  ---sys_munmap
>                     entry_SYSCALL_64_fastpath
>                     __GI___munmap
> 
>      0.57%     0.00%  ls       [kernel.vmlinux]    [k] vm_munmap                        
>                  |
>                  ---vm_munmap
>                     sys_munmap
>                     entry_SYSCALL_64_fastpath
>                     __GI___munmap
> 
>      0.57%     0.00%  ls       [kernel.vmlinux]    [k] do_munmap                        
>                  |
>                  ---do_munmap
>                     vm_munmap
>                     sys_munmap
>                     entry_SYSCALL_64_fastpath
>                     __GI___munmap
> 
>      0.57%     0.00%  ls       [kernel.vmlinux]    [k] remove_vma                       
>                  |
>                  ---remove_vma
>                     do_munmap
>                     vm_munmap
>                     sys_munmap
>                     entry_SYSCALL_64_fastpath
>                     __GI___munmap
> 
>      0.57%     0.57%  ls       [kernel.vmlinux]    [k] kmem_cache_free                  
>                  |
>                  ---kmem_cache_free
>                     remove_vma
>                     do_munmap
>                     vm_munmap
>                     sys_munmap
>                     entry_SYSCALL_64_fastpath
>                     __GI___munmap
> 
>      0.32%     0.00%  ls       [kernel.vmlinux]    [k] msg_print_text                   
>                  |
>                  ---msg_print_text
>                     console_unlock
>                     vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>      0.32%     0.00%  ls       [kernel.vmlinux]    [k] print_prefix                     
>                  |
>                  ---print_prefix
>                     msg_print_text
>                     console_unlock
>                     vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>      0.32%     0.00%  ls       [kernel.vmlinux]    [k] print_time.part.12               
>                  |
>                  ---print_time.part.12
>                     print_prefix
>                     msg_print_text
>                     console_unlock
>                     vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>      0.32%     0.00%  ls       [kernel.vmlinux]    [k] sprintf                          
>                  |
>                  ---sprintf
>                     print_time.part.12
>                     print_prefix
>                     msg_print_text
>                     console_unlock
>                     vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>      0.32%     0.00%  ls       [kernel.vmlinux]    [k] vsnprintf                        
>                  |
>                  ---vsnprintf
>                     sprintf
>                     print_time.part.12
>                     print_prefix
>                     msg_print_text
>                     console_unlock
>                     vprintk_emit
>                     vprintk_default
>                     printk
>                     perf_duration_warn
>                     irq_work_run_list
>                     irq_work_run
>                     smp_irq_work_interrupt
>                     irq_work_interrupt
>                     __inode_permission
>                     inode_permission
>                     link_path_walk
>                     path_openat
>                     do_filp_open
>                     do_sys_open
>                     sys_open
>                     entry_SYSCALL_64_fastpath
>                     open64
>                     0x686361632e6f732e
> 
>      0.32%     0.00%  ls       ld-2.18.so          [.] 0xffff804cabb62640               
>                  |
>                  ---0x21e640
>                     0
> 
>      0.32%     0.32%  ls       ld-2.18.so          [.] _dl_setup_hash                   
>                  |
>                  ---_dl_setup_hash
>                     _dl_map_object
>                     0x21e640
>                     0
> 
>      0.29%     0.00%  ls       [unknown]           [k] 0x00007f9abb498a77               
>                  |
>                  ---0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] return_from_execve               
>                  |
>                  ---return_from_execve
>                     0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] sys_execve                       
>                  |
>                  ---sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] do_execveat_common.isra.32       
>                  |
>                  ---do_execveat_common.isra.32
>                     sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] search_binary_handler            
>                  |
>                  ---search_binary_handler
>                     do_execveat_common.isra.32
>                     sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] load_elf_binary                  
>                  |
>                  ---load_elf_binary
>                     search_binary_handler
>                     do_execveat_common.isra.32
>                     sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] setup_new_exec                   
>                  |
>                  ---setup_new_exec
>                     load_elf_binary
>                     search_binary_handler
>                     do_execveat_common.isra.32
>                     sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] apic_timer_interrupt             
>                  |
>                  ---apic_timer_interrupt
>                     setup_new_exec
>                     load_elf_binary
>                     search_binary_handler
>                     do_execveat_common.isra.32
>                     sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] smp_apic_timer_interrupt         
>                  |
>                  ---smp_apic_timer_interrupt
>                     apic_timer_interrupt
>                     setup_new_exec
>                     load_elf_binary
>                     search_binary_handler
>                     do_execveat_common.isra.32
>                     sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] local_apic_timer_interrupt       
>                  |
>                  ---local_apic_timer_interrupt
>                     smp_apic_timer_interrupt
>                     apic_timer_interrupt
>                     setup_new_exec
>                     load_elf_binary
>                     search_binary_handler
>                     do_execveat_common.isra.32
>                     sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] hrtimer_interrupt                
>                  |
>                  ---hrtimer_interrupt
>                     local_apic_timer_interrupt
>                     smp_apic_timer_interrupt
>                     apic_timer_interrupt
>                     setup_new_exec
>                     load_elf_binary
>                     search_binary_handler
>                     do_execveat_common.isra.32
>                     sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] __hrtimer_run_queues             
>                  |
>                  ---__hrtimer_run_queues
>                     hrtimer_interrupt
>                     local_apic_timer_interrupt
>                     smp_apic_timer_interrupt
>                     apic_timer_interrupt
>                     setup_new_exec
>                     load_elf_binary
>                     search_binary_handler
>                     do_execveat_common.isra.32
>                     sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] tick_sched_timer                 
>                  |
>                  ---tick_sched_timer
>                     __hrtimer_run_queues
>                     hrtimer_interrupt
>                     local_apic_timer_interrupt
>                     smp_apic_timer_interrupt
>                     apic_timer_interrupt
>                     setup_new_exec
>                     load_elf_binary
>                     search_binary_handler
>                     do_execveat_common.isra.32
>                     sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] tick_sched_handle.isra.17        
>                  |
>                  ---tick_sched_handle.isra.17
>                     tick_sched_timer
>                     __hrtimer_run_queues
>                     hrtimer_interrupt
>                     local_apic_timer_interrupt
>                     smp_apic_timer_interrupt
>                     apic_timer_interrupt
>                     setup_new_exec
>                     load_elf_binary
>                     search_binary_handler
>                     do_execveat_common.isra.32
>                     sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] update_process_times             
>                  |
>                  ---update_process_times
>                     tick_sched_handle.isra.17
>                     tick_sched_timer
>                     __hrtimer_run_queues
>                     hrtimer_interrupt
>                     local_apic_timer_interrupt
>                     smp_apic_timer_interrupt
>                     apic_timer_interrupt
>                     setup_new_exec
>                     load_elf_binary
>                     search_binary_handler
>                     do_execveat_common.isra.32
>                     sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
>      0.21%     0.00%  ls       [kernel.vmlinux]    [k] scheduler_tick                   
>                  |
>                  ---scheduler_tick
>                     update_process_times
>                     tick_sched_handle.isra.17
>                     tick_sched_timer
>                     __hrtimer_run_queues
>                     hrtimer_interrupt
>                     local_apic_timer_interrupt
>                     smp_apic_timer_interrupt
>                     apic_timer_interrupt
>                     setup_new_exec
>                     load_elf_binary
>                     search_binary_handler
>                     do_execveat_common.isra.32
>                     sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
>      0.08%     0.08%  ls       [kernel.vmlinux]    [k] native_sched_clock               
>                  |
>                  ---native_sched_clock
>                     0x7f9abb498a77
> 
>      0.00%     0.00%  ls       [kernel.vmlinux]    [k] perf_event_exec                  
>                  |
>                  ---perf_event_exec
>                     setup_new_exec
>                     load_elf_binary
>                     search_binary_handler
>                     do_execveat_common.isra.32
>                     sys_execve
>                     return_from_execve
>                     0x7f9abb498a77
> 
> 
> 
> # Samples: 158  of event 'cpu/instructions,call-graph=no,time=0,period=20000/p'
> # Event count (approx.): 3762761
> #
> # Children      Self  Command  Shared Object     Symbol                            
> # ........  ........  .......  ................  ..................................
> #
>      5.87%     5.87%  ls       [unknown]         [.] 0x00007fb353d5cf7e            
> 
>      4.84%     4.84%  ls       [kernel.vmlinux]  [k] delay_tsc                     
> 
>      3.77%     3.77%  ls       [kernel.vmlinux]  [k] pick_next_task_fair           
> 
>      3.11%     3.11%  ls       [kernel.vmlinux]  [k] unmap_page_range              
> 
>      2.94%     2.94%  ls       [kernel.vmlinux]  [k] n_tty_write                   
> 
>      2.48%     2.48%  ls       [unknown]         [.] 0x000000000040669a            
> 
>      2.40%     2.40%  ls       [unknown]         [.] 0x00007fb353d5cd1a            
> 
>      2.37%     2.37%  ls       [unknown]         [.] 0x00007fb353d5cca4            
> 
>      2.37%     2.37%  ls       [unknown]         [.] 0x00000000004066ca            
> 
>      2.25%     2.25%  ls       [unknown]         [.] 0x00007fb353d5db87            
> 
>      2.03%     2.03%  ls       [unknown]         [.] 0x00007fb353d5ccaa            
> 
>      1.98%     1.98%  ls       [unknown]         [.] 0x00007fb353d5cc9c            
> 
>      1.97%     1.97%  ls       [unknown]         [.] 0x0000000000405b2a            
> 
>      1.89%     1.89%  ls       [unknown]         [.] 0x00007fb3546d43e0            
> 
>      1.83%     1.83%  ls       [unknown]         [.] 0x00007fb353d5cef6            
> 
>      1.75%     1.75%  ls       [kernel.vmlinux]  [k] ring_buffer_record_is_on      
> 
>      1.69%     1.69%  ls       [unknown]         [.] 0x00007fb353d5cc3a            
> 
>      1.63%     1.63%  ls       [unknown]         [.] 0x0000000000405611            
> 
>      1.47%     1.47%  ls       [kernel.vmlinux]  [k] __fput                        
> 
>      1.44%     1.44%  ls       [kernel.vmlinux]  [k] release_pages                 
> 
>      1.37%     1.37%  ls       [kernel.vmlinux]  [k] perf_pmu_sched_task           
> 
>      1.34%     1.34%  ls       [unknown]         [.] 0x00007fb353d54fed            
> 
>      1.33%     1.33%  ls       [kernel.vmlinux]  [k] __memcpy                      
> 
>      1.33%     1.33%  ls       [unknown]         [.] 0x00007fb353d5df34            
> 
>      1.31%     1.31%  ls       [unknown]         [.] 0x00007fb353d5ccdf            
> 
>      1.29%     1.29%  ls       [unknown]         [.] 0x0000000000406a19            
> 
>      1.29%     1.29%  ls       [kernel.vmlinux]  [k] page_remove_rmap              
> 
>      1.29%     1.29%  ls       [kernel.vmlinux]  [k] do_set_pte                    
> 
>      1.28%     1.28%  ls       [kernel.vmlinux]  [k] __audit_syscall_exit          
> 
>      1.28%     1.28%  ls       [kernel.vmlinux]  [k] enqueue_entity                
> 
>      1.28%     1.28%  ls       [ext4]            [k] ext4fs_dirhash                
> 
>      1.26%     1.26%  ls       [kernel.vmlinux]  [k] cpuacct_charge                
> 
>      1.24%     1.24%  ls       [kernel.vmlinux]  [k] sched_clock                   
> 
>      1.24%     1.24%  ls       [unknown]         [.] 0x00007fb353d4bca5            
> 
>      1.22%     1.22%  ls       [unknown]         [.] 0x00007fb353dfb6ac            
> 
>      1.21%     1.21%  ls       [ext4]            [k] str2hashbuf_signed            
> 
>      1.21%     1.21%  ls       [unknown]         [.] 0x00007fb3546c766a            
> 
>      1.20%     1.20%  ls       [ext4]            [k] __ext4_check_dir_entry        
> 
>      1.13%     1.13%  ls       [kernel.vmlinux]  [k] x86_pmu_disable               
> 
>      1.12%     1.12%  ls       [unknown]         [.] 0x00007fb3546c5571            
> 
>      1.11%     1.11%  ls       [kernel.vmlinux]  [k] vm_normal_page                
> 
>      1.09%     1.09%  ls       [unknown]         [.] 0x00007fb3546cc246            
> 
>      1.06%     1.06%  ls       [unknown]         [.] 0x00007fb3546cc21e            
> 
>      1.03%     1.03%  ls       [unknown]         [.] 0x000000000040e6a0            
> 
>      1.01%     1.01%  ls       [unknown]         [.] 0x00007fb3546c5ce3            
> 
>      0.88%     0.88%  ls       [unknown]         [.] 0x00007fb3546c7814            
> 
>      0.88%     0.88%  ls       [kernel.vmlinux]  [k] mark_page_accessed            
> 
>      0.87%     0.87%  ls       [unknown]         [.] 0x00007fb3546c7960            
> 
>      0.78%     0.78%  ls       [unknown]         [.] 0x000000000040e7ea            
> 
>      0.77%     0.77%  ls       [kernel.vmlinux]  [k] security_mmap_file            
> 
>      0.66%     0.66%  ls       [unknown]         [.] 0x000000000040f3c5            
> 
>      0.65%     0.65%  ls       [kernel.vmlinux]  [k] enqueue_task_fair             
> 
>      0.63%     0.63%  ls       [kernel.vmlinux]  [k] unlock_page                   
> 
>      0.61%     0.61%  ls       [kernel.vmlinux]  [k] place_entity                  
> 
>      0.57%     0.57%  ls       [unknown]         [.] 0x000000000040e808            
> 
>      0.56%     0.56%  ls       [kernel.vmlinux]  [k] perf_event_aux_ctx            
> 
>      0.54%     0.54%  ls       [kernel.vmlinux]  [k] __rb_insert_augmented         
> 
>      0.54%     0.54%  ls       [kernel.vmlinux]  [k] update_min_vruntime           
> 
>      0.50%     0.50%  ls       [kernel.vmlinux]  [k] update_curr                   
> 
>      0.47%     0.47%  ls       [kernel.vmlinux]  [k] vma_interval_tree_insert      
> 
>      0.47%     0.47%  ls       [kernel.vmlinux]  [k] io_serial_in                  
> 
>      0.47%     0.47%  ls       [kernel.vmlinux]  [k] check_cfs_rq_runtime          
> 
>      0.46%     0.46%  ls       [kernel.vmlinux]  [k] tracing_record_cmdline        
> 
>      0.46%     0.46%  ls       [kernel.vmlinux]  [k] __dec_zone_page_state         
> 
>      0.42%     0.42%  ls       [kernel.vmlinux]  [k] try_to_wake_up                
> 
>      0.40%     0.40%  ls       [kernel.vmlinux]  [k] insert_work                   
> 
>      0.40%     0.40%  ls       [kernel.vmlinux]  [k] put_prev_entity               
> 
>      0.40%     0.40%  ls       [kernel.vmlinux]  [k] avc_has_perm_noaudit          
> 
>      0.38%     0.38%  ls       [kernel.vmlinux]  [k] __list_del_entry              
> 
>      0.38%     0.38%  ls       [unknown]         [.] 0x0000000000405852            
> 
>      0.36%     0.36%  ls       [kernel.vmlinux]  [k] __intel_pmu_disable_all       
> 
>      0.35%     0.35%  ls       [kernel.vmlinux]  [k] ttwu_do_activate.constprop.92 
> 
>      0.35%     0.35%  ls       [kernel.vmlinux]  [k] mem_cgroup_begin_page_stat    
> 
>      0.34%     0.34%  ls       [kernel.vmlinux]  [k] perf_ctx_unlock               
> 
>      0.32%     0.32%  ls       [unknown]         [.] 0x0000000000405b46            
> 
>      0.32%     0.32%  ls       [unknown]         [.] 0x0000000000405811            
> 
>      0.31%     0.31%  ls       [unknown]         [.] 0x00007fb3546c54fa            
> 
>      0.31%     0.31%  ls       [kernel.vmlinux]  [k] rb_next                       
> 
>      0.31%     0.31%  ls       [kernel.vmlinux]  [k] tracing_is_on                 
> 
>      0.30%     0.30%  ls       [unknown]         [.] 0x00007fb3546c553d            
> 
>      0.29%     0.29%  ls       [unknown]         [.] 0x00007fb3546cb597            
> 
>      0.20%     0.20%  ls       [kernel.vmlinux]  [k] format_decode                 
> 
>      0.18%     0.18%  ls       [kernel.vmlinux]  [k] __audit_syscall_entry         
> 
>      0.16%     0.16%  ls       [kernel.vmlinux]  [k] arch_get_unmapped_area_topdown
> 
>      0.16%     0.16%  ls       [kernel.vmlinux]  [k] fsnotify                      
> 
>      0.16%     0.16%  ls       [kernel.vmlinux]  [k] intel_bts_enable_local        
> 
>      0.15%     0.15%  ls       [kernel.vmlinux]  [k] selinux_inode_permission      
> 
>      0.14%     0.14%  ls       [kernel.vmlinux]  [k] wait_for_xmitr                
> 
>      0.14%     0.14%  ls       [kernel.vmlinux]  [k] __const_udelay                
> 
>      0.11%     0.11%  ls       [kernel.vmlinux]  [k] find_vma                      
> 
>      0.11%     0.11%  ls       [unknown]         [.] 0x00007fb3546d18ae            
> 
>      0.10%     0.10%  ls       [unknown]         [.] 0x00007fb3546cb18e            
> 
>      0.03%     0.03%  ls       [kernel.vmlinux]  [k] native_sched_clock            
> 
>      0.01%     0.01%  ls       [kernel.vmlinux]  [k] trigger_load_balance          
> 
>      0.01%     0.01%  ls       [kernel.vmlinux]  [k] do_nmi                        
> 
>      0.00%     0.00%  ls       [kernel.vmlinux]  [k] perf_event_nmi_handler        
> 
>      0.00%     0.00%  ls       [kernel.vmlinux]  [k] perf_sample_event_took        
> 
>      0.00%     0.00%  ls       [kernel.vmlinux]  [k] nmi                           
> 
> 
> 
> #
> # (For a higher level overview, try: perf report --sort comm,dso)
> #

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ