FIT Profiler Report

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Action                                                                                                                                                                                                     	|  Mean duration (s)	|  Num calls      	|  Total time (s) 	|  Percentage %   	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Total                                                                                                                                                                                                      	|  -              	|  885105         	|  2892.7         	|  100 %          	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  run_training_epoch                                                                                                                                                                                         	|  137.07         	|  20             	|  2741.3         	|  94.769         	|
|  run_training_batch                                                                                                                                                                                         	|  0.11422        	|  20000          	|  2284.5         	|  78.975         	|
|  [LightningModule]NeRFSystem.optimizer_step                                                                                                                                                                 	|  0.11383        	|  20000          	|  2276.6         	|  78.702         	|
|  [Strategy]SingleDeviceStrategy.training_step                                                                                                                                                               	|  0.029025       	|  20000          	|  580.51         	|  20.068         	|
|  [Strategy]SingleDeviceStrategy.validation_step                                                                                                                                                             	|  0.89808        	|  290            	|  260.44         	|  9.0036         	|
|  [TrainingEpochLoop].train_dataloader_next                                                                                                                                                                  	|  0.0081907      	|  20000          	|  163.81         	|  5.6631         	|
|  [LightningModule]NeRFSystem.setup                                                                                                                                                                          	|  138.28         	|  1              	|  138.28         	|  4.7803         	|
|  [Strategy]SingleDeviceStrategy.backward                                                                                                                                                                    	|  0.0045358      	|  20000          	|  90.716         	|  3.1361         	|
|  [Callback]TQDMProgressBar.on_train_batch_end                                                                                                                                                               	|  0.0005195      	|  20000          	|  10.39          	|  0.35918        	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_epoch_end                 	|  0.22896        	|  20             	|  4.5792         	|  0.1583         	|
|  [Strategy]SingleDeviceStrategy.batch_to_device                                                                                                                                                             	|  0.00017171     	|  20290          	|  3.484          	|  0.12044        	|
|  [LightningModule]NeRFSystem.transfer_batch_to_device                                                                                                                                                       	|  0.00010445     	|  20290          	|  2.1192         	|  0.073262       	|
|  [EvaluationEpochLoop].val_dataloader_idx_0_next                                                                                                                                                            	|  0.0026069      	|  290            	|  0.756          	|  0.026135       	|
|  [LightningModule]NeRFSystem.optimizer_zero_grad                                                                                                                                                            	|  3.0319e-05     	|  20000          	|  0.60638        	|  0.020963       	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_batch_end                 	|  2.0644e-05     	|  20000          	|  0.41288        	|  0.014273       	|
|  [LightningModule]NeRFSystem.configure_gradient_clipping                                                                                                                                                    	|  1.8591e-05     	|  20000          	|  0.37182        	|  0.012854       	|
|  [Callback]TQDMProgressBar.on_validation_batch_end                                                                                                                                                          	|  0.00045518     	|  290            	|  0.132          	|  0.0045633      	|
|  [Callback]GradientAccumulationScheduler.on_train_batch_end                                                                                                                                                 	|  6.276e-06      	|  20000          	|  0.12552        	|  0.0043393      	|
|  [Callback]TQDMProgressBar.on_after_backward                                                                                                                                                                	|  5.9024e-06     	|  20000          	|  0.11805        	|  0.0040809      	|
|  [Callback]TQDMProgressBar.on_before_optimizer_step                                                                                                                                                         	|  5.6317e-06     	|  20000          	|  0.11263        	|  0.0038938      	|
|  [Callback]TQDMProgressBar.on_batch_start                                                                                                                                                                   	|  5.6179e-06     	|  20000          	|  0.11236        	|  0.0038842      	|
|  [Callback]TQDMProgressBar.on_before_zero_grad                                                                                                                                                              	|  5.0262e-06     	|  20000          	|  0.10052        	|  0.0034751      	|
|  [Callback]TQDMProgressBar.on_before_backward                                                                                                                                                               	|  4.7077e-06     	|  20000          	|  0.094154       	|  0.0032549      	|
|  [Callback]GradientAccumulationScheduler.on_batch_start                                                                                                                                                     	|  4.6473e-06     	|  20000          	|  0.092946       	|  0.0032132      	|
|  [Callback]TQDMProgressBar.on_train_batch_start                                                                                                                                                             	|  4.6157e-06     	|  20000          	|  0.092315       	|  0.0031913      	|
|  [LightningModule]NeRFSystem.on_validation_start                                                                                                                                                            	|  0.043991       	|  2              	|  0.087983       	|  0.0030416      	|
|  [LightningModule]NeRFSystem.on_before_batch_transfer                                                                                                                                                       	|  4.2175e-06     	|  20290          	|  0.085573       	|  0.0029583      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_after_backward                  	|  4.1086e-06     	|  20000          	|  0.082172       	|  0.0028407      	|
|  [Callback]TQDMProgressBar.on_batch_end                                                                                                                                                                     	|  4.1067e-06     	|  20000          	|  0.082135       	|  0.0028394      	|
|  [Callback]GradientAccumulationScheduler.on_after_backward                                                                                                                                                  	|  4.0532e-06     	|  20000          	|  0.081065       	|  0.0028024      	|
|  [Callback]GradientAccumulationScheduler.on_train_batch_start                                                                                                                                               	|  4.0432e-06     	|  20000          	|  0.080864       	|  0.0027955      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_batch_start                     	|  4.0216e-06     	|  20000          	|  0.080431       	|  0.0027805      	|
|  [Callback]GradientAccumulationScheduler.on_before_optimizer_step                                                                                                                                           	|  4.0136e-06     	|  20000          	|  0.080272       	|  0.002775       	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_batch_start               	|  4.0099e-06     	|  20000          	|  0.080197       	|  0.0027724      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_optimizer_step           	|  4.0056e-06     	|  20000          	|  0.080113       	|  0.0027695      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_batch_end                       	|  3.9714e-06     	|  20000          	|  0.079428       	|  0.0027458      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_backward                 	|  3.9432e-06     	|  20000          	|  0.078864       	|  0.0027263      	|
|  [Callback]GradientAccumulationScheduler.on_batch_end                                                                                                                                                       	|  3.9403e-06     	|  20000          	|  0.078805       	|  0.0027243      	|
|  [Callback]GradientAccumulationScheduler.on_before_zero_grad                                                                                                                                                	|  3.9393e-06     	|  20000          	|  0.078786       	|  0.0027236      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_zero_grad                	|  3.936e-06      	|  20000          	|  0.07872        	|  0.0027214      	|
|  [Callback]GradientAccumulationScheduler.on_before_backward                                                                                                                                                 	|  3.933e-06      	|  20000          	|  0.07866        	|  0.0027193      	|
|  [LightningModule]NeRFSystem.training_step_end                                                                                                                                                              	|  3.2551e-06     	|  20000          	|  0.065102       	|  0.0022506      	|
|  [LightningModule]NeRFSystem.on_after_batch_transfer                                                                                                                                                        	|  3.168e-06      	|  20290          	|  0.064279       	|  0.0022221      	|
|  [LightningModule]NeRFSystem.on_train_batch_start                                                                                                                                                           	|  2.7956e-06     	|  20000          	|  0.055912       	|  0.0019329      	|
|  [LightningModule]NeRFSystem.on_train_batch_end                                                                                                                                                             	|  2.6953e-06     	|  20000          	|  0.053906       	|  0.0018635      	|
|  [Strategy]SingleDeviceStrategy.on_train_batch_start                                                                                                                                                        	|  2.6946e-06     	|  20000          	|  0.053891       	|  0.001863       	|
|  [LightningModule]NeRFSystem.on_before_optimizer_step                                                                                                                                                       	|  2.6797e-06     	|  20000          	|  0.053595       	|  0.0018528      	|
|  [LightningModule]NeRFSystem.on_before_zero_grad                                                                                                                                                            	|  2.6622e-06     	|  20000          	|  0.053245       	|  0.0018407      	|
|  [Strategy]SingleDeviceStrategy.training_step_end                                                                                                                                                           	|  2.6583e-06     	|  20000          	|  0.053166       	|  0.0018379      	|
|  [LightningModule]NeRFSystem.on_after_backward                                                                                                                                                              	|  2.4886e-06     	|  20000          	|  0.049771       	|  0.0017206      	|
|  [LightningModule]NeRFSystem.on_before_backward                                                                                                                                                             	|  2.4167e-06     	|  20000          	|  0.048334       	|  0.0016709      	|
|  [LightningModule]NeRFSystem.validation_epoch_end                                                                                                                                                           	|  0.0043645      	|  2              	|  0.008729       	|  0.00030176     	|
|  [Callback]TQDMProgressBar.on_train_epoch_end                                                                                                                                                               	|  0.00029786     	|  20             	|  0.0059571      	|  0.00020594     	|
|  [LightningModule]NeRFSystem.configure_optimizers                                                                                                                                                           	|  0.0051664      	|  1              	|  0.0051664      	|  0.0001786      	|
|  [Callback]TQDMProgressBar.on_train_epoch_start                                                                                                                                                             	|  0.00025083     	|  20             	|  0.0050167      	|  0.00017343     	|
|  [Callback]TQDMProgressBar.on_validation_batch_start                                                                                                                                                        	|  1.6328e-05     	|  290            	|  0.0047352      	|  0.0001637      	|
|  [LightningModule]NeRFSystem.lr_scheduler_step                                                                                                                                                              	|  0.00013641     	|  20             	|  0.0027282      	|  9.4313e-05     	|
|  [Callback]GradientAccumulationScheduler.on_validation_batch_end                                                                                                                                            	|  7.7931e-06     	|  290            	|  0.00226        	|  7.8129e-05     	|
|  [Callback]GradientAccumulationScheduler.on_validation_batch_start                                                                                                                                          	|  4.9064e-06     	|  290            	|  0.0014229      	|  4.9189e-05     	|
|  [LightningModule]NeRFSystem.validation_step_end                                                                                                                                                            	|  4.7019e-06     	|  290            	|  0.0013636      	|  4.7138e-05     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_batch_start          	|  4.6222e-06     	|  290            	|  0.0013404      	|  4.6339e-05     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_batch_end            	|  4.4349e-06     	|  290            	|  0.0012861      	|  4.4461e-05     	|
|  [LightningModule]NeRFSystem.on_validation_batch_start                                                                                                                                                      	|  4.0654e-06     	|  290            	|  0.001179       	|  4.0758e-05     	|
|  [LightningModule]NeRFSystem.on_validation_model_train                                                                                                                                                      	|  0.00058128     	|  2              	|  0.0011626      	|  4.019e-05      	|
|  [LightningModule]NeRFSystem.on_validation_model_eval                                                                                                                                                       	|  0.00055327     	|  2              	|  0.0011065      	|  3.8254e-05     	|
|  [LightningModule]NeRFSystem.on_validation_batch_end                                                                                                                                                        	|  3.7637e-06     	|  290            	|  0.0010915      	|  3.7732e-05     	|
|  [Callback]TQDMProgressBar.on_validation_end                                                                                                                                                                	|  0.00050292     	|  2              	|  0.0010058      	|  3.4772e-05     	|
|  [LightningModule]NeRFSystem.train_dataloader                                                                                                                                                               	|  0.00085721     	|  1              	|  0.00085721     	|  2.9634e-05     	|
|  [Strategy]SingleDeviceStrategy.validation_step_end                                                                                                                                                         	|  2.8685e-06     	|  290            	|  0.00083186     	|  2.8757e-05     	|
|  [Callback]TQDMProgressBar.on_validation_start                                                                                                                                                              	|  0.00028645     	|  2              	|  0.0005729      	|  1.9805e-05     	|
|  [Callback]TQDMProgressBar.on_train_start                                                                                                                                                                   	|  0.0003955      	|  1              	|  0.0003955      	|  1.3673e-05     	|
|  [LightningModule]NeRFSystem.val_dataloader                                                                                                                                                                 	|  0.00031889     	|  1              	|  0.00031889     	|  1.1024e-05     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_epoch_end                       	|  1.2355e-05     	|  22             	|  0.00027181     	|  9.3967e-06     	|
|  [Callback]TQDMProgressBar.on_train_end                                                                                                                                                                     	|  0.0002603      	|  1              	|  0.0002603      	|  8.9985e-06     	|
|  [Callback]GradientAccumulationScheduler.on_train_epoch_start                                                                                                                                               	|  7.8916e-06     	|  20             	|  0.00015783     	|  5.4563e-06     	|
|  [Callback]GradientAccumulationScheduler.on_train_epoch_end                                                                                                                                                 	|  6.1354e-06     	|  20             	|  0.00012271     	|  4.242e-06      	|
|  [Callback]TQDMProgressBar.on_epoch_start                                                                                                                                                                   	|  5.2949e-06     	|  22             	|  0.00011649     	|  4.027e-06      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_epoch_start                     	|  4.1682e-06     	|  22             	|  9.17e-05       	|  3.1701e-06     	|
|  [Callback]TQDMProgressBar.on_epoch_end                                                                                                                                                                     	|  4.1617e-06     	|  22             	|  9.1558e-05     	|  3.1652e-06     	|
|  [Callback]GradientAccumulationScheduler.on_epoch_start                                                                                                                                                     	|  3.9174e-06     	|  22             	|  8.6184e-05     	|  2.9794e-06     	|
|  [Callback]GradientAccumulationScheduler.on_epoch_end                                                                                                                                                       	|  3.9018e-06     	|  22             	|  8.5839e-05     	|  2.9675e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_epoch_start               	|  4.1799e-06     	|  20             	|  8.3598e-05     	|  2.89e-06       	|
|  [LightningModule]NeRFSystem.on_epoch_start                                                                                                                                                                 	|  3.6156e-06     	|  22             	|  7.9542e-05     	|  2.7498e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_end                  	|  3.74e-05       	|  2              	|  7.48e-05       	|  2.5859e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_end                                                                                                                                                             	|  3.7367e-06     	|  20             	|  7.4734e-05     	|  2.5836e-06     	|
|  [LightningModule]NeRFSystem.on_epoch_end                                                                                                                                                                   	|  2.9808e-06     	|  22             	|  6.5577e-05     	|  2.267e-06      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.setup                              	|  6.0482e-05     	|  1              	|  6.0482e-05     	|  2.0909e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_start                                                                                                                                                           	|  2.7237e-06     	|  20             	|  5.4475e-05     	|  1.8832e-06     	|
|  [Callback]TQDMProgressBar.on_validation_epoch_end                                                                                                                                                          	|  1.4457e-05     	|  2              	|  2.8914e-05     	|  9.9956e-07     	|
|  [Callback]TQDMProgressBar.on_validation_epoch_start                                                                                                                                                        	|  8.5551e-06     	|  2              	|  1.711e-05      	|  5.9151e-07     	|
|  [LightningModule]NeRFSystem.on_validation_end                                                                                                                                                              	|  8.2767e-06     	|  2              	|  1.6553e-05     	|  5.7225e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_end                                                                                                                                                  	|  7.2983e-06     	|  2              	|  1.4597e-05     	|  5.0461e-07     	|
|  [LightningModule]NeRFSystem.configure_callbacks                                                                                                                                                            	|  1.3201e-05     	|  1              	|  1.3201e-05     	|  4.5635e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_start                                                                                                                                                	|  6.3907e-06     	|  2              	|  1.2781e-05     	|  4.4186e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_start                     	|  1.1734e-05     	|  1              	|  1.1734e-05     	|  4.0564e-07     	|
|  [Callback]TQDMProgressBar.setup                                                                                                                                                                            	|  1.1384e-05     	|  1              	|  1.1384e-05     	|  3.9356e-07     	|
|  [LightningModule]NeRFSystem.on_fit_start                                                                                                                                                                   	|  1.0406e-05     	|  1              	|  1.0406e-05     	|  3.5973e-07     	|
|  [Callback]TQDMProgressBar.on_pretrain_routine_start                                                                                                                                                        	|  9.9875e-06     	|  1              	|  9.9875e-06     	|  3.4527e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_epoch_end                                                                                                                                            	|  4.2953e-06     	|  2              	|  8.5905e-06     	|  2.9698e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_epoch_end            	|  4.2948e-06     	|  2              	|  8.5896e-06     	|  2.9694e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_epoch_start                                                                                                                                          	|  4.0857e-06     	|  2              	|  8.1714e-06     	|  2.8249e-07     	|
|  [Callback]GradientAccumulationScheduler.on_train_start                                                                                                                                                     	|  8.1025e-06     	|  1              	|  8.1025e-06     	|  2.8011e-07     	|
|  [Callback]TQDMProgressBar.on_fit_start                                                                                                                                                                     	|  8.0317e-06     	|  1              	|  8.0317e-06     	|  2.7766e-07     	|
|  [Strategy]SingleDeviceStrategy.on_validation_start                                                                                                                                                         	|  4.0154e-06     	|  2              	|  8.0308e-06     	|  2.7763e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_start                	|  3.8408e-06     	|  2              	|  7.6815e-06     	|  2.6555e-07     	|
|  [Callback]TQDMProgressBar.on_fit_end                                                                                                                                                                       	|  7.5428e-06     	|  1              	|  7.5428e-06     	|  2.6076e-07     	|
|  [LightningModule]NeRFSystem.configure_sharded_model                                                                                                                                                        	|  7.5419e-06     	|  1              	|  7.5419e-06     	|  2.6072e-07     	|
|  [Strategy]SingleDeviceStrategy.on_validation_end                                                                                                                                                           	|  3.6317e-06     	|  2              	|  7.2634e-06     	|  2.511e-07      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_epoch_start          	|  3.5269e-06     	|  2              	|  7.0538e-06     	|  2.4385e-07     	|
|  [LightningModule]NeRFSystem.on_validation_epoch_end                                                                                                                                                        	|  3.1083e-06     	|  2              	|  6.2166e-06     	|  2.1491e-07     	|
|  [LightningModule]NeRFSystem.on_validation_epoch_start                                                                                                                                                      	|  2.8987e-06     	|  2              	|  5.7975e-06     	|  2.0042e-07     	|
|  [Callback]GradientAccumulationScheduler.setup                                                                                                                                                              	|  5.7267e-06     	|  1              	|  5.7267e-06     	|  1.9797e-07     	|
|  [Callback]GradientAccumulationScheduler.on_train_end                                                                                                                                                       	|  5.3085e-06     	|  1              	|  5.3085e-06     	|  1.8352e-07     	|
|  [LightningModule]NeRFSystem.prepare_data                                                                                                                                                                   	|  4.7488e-06     	|  1              	|  4.7488e-06     	|  1.6417e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_configure_sharded_model         	|  4.3306e-06     	|  1              	|  4.3306e-06     	|  1.4971e-07     	|
|  [Callback]TQDMProgressBar.on_configure_sharded_model                                                                                                                                                       	|  4.3297e-06     	|  1              	|  4.3297e-06     	|  1.4968e-07     	|
|  [Callback]GradientAccumulationScheduler.on_configure_sharded_model                                                                                                                                         	|  4.2599e-06     	|  1              	|  4.2599e-06     	|  1.4726e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_fit_start                       	|  4.2599e-06     	|  1              	|  4.2599e-06     	|  1.4726e-07     	|
|  [Callback]GradientAccumulationScheduler.on_before_accelerator_backend_setup                                                                                                                                	|  4.191e-06      	|  1              	|  4.191e-06      	|  1.4488e-07     	|
|  [LightningModule]NeRFSystem.on_train_start                                                                                                                                                                 	|  4.191e-06      	|  1              	|  4.191e-06      	|  1.4488e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_pretrain_routine_start          	|  3.8426e-06     	|  1              	|  3.8426e-06     	|  1.3284e-07     	|
|  [Callback]TQDMProgressBar.on_pretrain_routine_end                                                                                                                                                          	|  3.8417e-06     	|  1              	|  3.8417e-06     	|  1.3281e-07     	|
|  [Callback]GradientAccumulationScheduler.teardown                                                                                                                                                           	|  3.8417e-06     	|  1              	|  3.8417e-06     	|  1.3281e-07     	|
|  [Callback]GradientAccumulationScheduler.on_pretrain_routine_start                                                                                                                                          	|  3.8408e-06     	|  1              	|  3.8408e-06     	|  1.3278e-07     	|
|  [Callback]GradientAccumulationScheduler.on_pretrain_routine_end                                                                                                                                            	|  3.8408e-06     	|  1              	|  3.8408e-06     	|  1.3278e-07     	|
|  [Strategy]SingleDeviceStrategy.on_train_start                                                                                                                                                              	|  3.8408e-06     	|  1              	|  3.8408e-06     	|  1.3278e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_fit_end                         	|  3.8408e-06     	|  1              	|  3.8408e-06     	|  1.3278e-07     	|
|  [Callback]TQDMProgressBar.teardown                                                                                                                                                                         	|  3.8408e-06     	|  1              	|  3.8408e-06     	|  1.3278e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_accelerator_backend_setup	|  3.7728e-06     	|  1              	|  3.7728e-06     	|  1.3043e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_pretrain_routine_end            	|  3.7719e-06     	|  1              	|  3.7719e-06     	|  1.3039e-07     	|
|  [Callback]TQDMProgressBar.on_before_accelerator_backend_setup                                                                                                                                              	|  3.7709e-06     	|  1              	|  3.7709e-06     	|  1.3036e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_end                       	|  3.7709e-06     	|  1              	|  3.7709e-06     	|  1.3036e-07     	|
|  [LightningModule]NeRFSystem.on_fit_end                                                                                                                                                                     	|  3.7709e-06     	|  1              	|  3.7709e-06     	|  1.3036e-07     	|
|  [LightningModule]NeRFSystem.teardown                                                                                                                                                                       	|  3.7709e-06     	|  1              	|  3.7709e-06     	|  1.3036e-07     	|
|  [LightningModule]NeRFSystem.on_save_checkpoint                                                                                                                                                             	|  3.7011e-06     	|  1              	|  3.7011e-06     	|  1.2795e-07     	|
|  [Strategy]SingleDeviceStrategy.on_train_end                                                                                                                                                                	|  3.4226e-06     	|  1              	|  3.4226e-06     	|  1.1832e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.teardown                           	|  3.2838e-06     	|  1              	|  3.2838e-06     	|  1.1352e-07     	|
|  [LightningModule]NeRFSystem.on_train_end                                                                                                                                                                   	|  3.2829e-06     	|  1              	|  3.2829e-06     	|  1.1349e-07     	|
|  [Callback]GradientAccumulationScheduler.on_fit_end                                                                                                                                                         	|  3.2829e-06     	|  1              	|  3.2829e-06     	|  1.1349e-07     	|
|  [Callback]GradientAccumulationScheduler.on_fit_start                                                                                                                                                       	|  3.282e-06      	|  1              	|  3.282e-06      	|  1.1346e-07     	|
|  [LightningModule]NeRFSystem.on_pretrain_routine_start                                                                                                                                                      	|  2.4438e-06     	|  1              	|  2.4438e-06     	|  8.4482e-08     	|
|  [LightningModule]NeRFSystem.on_pretrain_routine_end                                                                                                                                                        	|  1.9548e-06     	|  1              	|  1.9548e-06     	|  6.7579e-08     	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
