FIT Profiler Report

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Action                                                                                                                                                                                                     	|  Mean duration (s)	|  Num calls      	|  Total time (s) 	|  Percentage %   	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Total                                                                                                                                                                                                      	|  -              	|  881233         	|  1959.5         	|  100 %          	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  run_training_epoch                                                                                                                                                                                         	|  96.442         	|  20             	|  1928.8         	|  98.435         	|
|  run_training_batch                                                                                                                                                                                         	|  0.089785       	|  20000          	|  1795.7         	|  91.64          	|
|  [LightningModule]NeRFSystem.optimizer_step                                                                                                                                                                 	|  0.089422       	|  20000          	|  1788.4         	|  91.27          	|
|  [Strategy]SingleDeviceStrategy.training_step                                                                                                                                                               	|  0.024771       	|  20000          	|  495.43         	|  25.283         	|
|  [Strategy]SingleDeviceStrategy.backward                                                                                                                                                                    	|  0.0048178      	|  20000          	|  96.355         	|  4.9173         	|
|  [TrainingEpochLoop].train_dataloader_next                                                                                                                                                                  	|  0.0041102      	|  20000          	|  82.204         	|  4.1951         	|
|  [Strategy]SingleDeviceStrategy.validation_step                                                                                                                                                             	|  0.53872        	|  48             	|  25.859         	|  1.3196         	|
|  [LightningModule]NeRFSystem.setup                                                                                                                                                                          	|  19.78          	|  1              	|  19.78          	|  1.0094         	|
|  [Callback]TQDMProgressBar.on_train_batch_end                                                                                                                                                               	|  0.00048155     	|  20000          	|  9.631          	|  0.4915         	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_epoch_end                 	|  0.18386        	|  20             	|  3.6771         	|  0.18766        	|
|  [Strategy]SingleDeviceStrategy.batch_to_device                                                                                                                                                             	|  0.00013399     	|  20048          	|  2.6861         	|  0.13708        	|
|  [LightningModule]NeRFSystem.transfer_batch_to_device                                                                                                                                                       	|  8.632e-05      	|  20048          	|  1.7305         	|  0.088315       	|
|  [LightningModule]NeRFSystem.optimizer_zero_grad                                                                                                                                                            	|  2.7199e-05     	|  20000          	|  0.54398        	|  0.027761       	|
|  [LightningModule]NeRFSystem.configure_gradient_clipping                                                                                                                                                    	|  1.7687e-05     	|  20000          	|  0.35374        	|  0.018053       	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_batch_end                 	|  1.7038e-05     	|  20000          	|  0.34076        	|  0.01739        	|
|  [EvaluationEpochLoop].val_dataloader_idx_0_next                                                                                                                                                            	|  0.0052837      	|  48             	|  0.25362        	|  0.012943       	|
|  [LightningModule]NeRFSystem.on_validation_start                                                                                                                                                            	|  0.055784       	|  2              	|  0.11157        	|  0.0056937      	|
|  [Callback]GradientAccumulationScheduler.on_train_batch_end                                                                                                                                                 	|  4.6816e-06     	|  20000          	|  0.093633       	|  0.0047784      	|
|  [Callback]TQDMProgressBar.on_after_backward                                                                                                                                                                	|  3.5733e-06     	|  20000          	|  0.071467       	|  0.0036472      	|
|  [Callback]TQDMProgressBar.on_batch_start                                                                                                                                                                   	|  3.5096e-06     	|  20000          	|  0.070192       	|  0.0035821      	|
|  [Callback]TQDMProgressBar.on_before_optimizer_step                                                                                                                                                         	|  3.3109e-06     	|  20000          	|  0.066218       	|  0.0033793      	|
|  [Callback]TQDMProgressBar.on_before_zero_grad                                                                                                                                                              	|  2.9863e-06     	|  20000          	|  0.059726       	|  0.003048       	|
|  [Callback]TQDMProgressBar.on_before_backward                                                                                                                                                               	|  2.9073e-06     	|  20000          	|  0.058146       	|  0.0029674      	|
|  [Callback]TQDMProgressBar.on_train_batch_start                                                                                                                                                             	|  2.7907e-06     	|  20000          	|  0.055814       	|  0.0028484      	|
|  [Callback]GradientAccumulationScheduler.on_batch_start                                                                                                                                                     	|  2.761e-06      	|  20000          	|  0.05522        	|  0.0028181      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_batch_start                     	|  2.6559e-06     	|  20000          	|  0.053118       	|  0.0027108      	|
|  [Callback]GradientAccumulationScheduler.on_train_batch_start                                                                                                                                               	|  2.5632e-06     	|  20000          	|  0.051264       	|  0.0026162      	|
|  [Callback]TQDMProgressBar.on_batch_end                                                                                                                                                                     	|  2.4743e-06     	|  20000          	|  0.049485       	|  0.0025254      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_batch_start               	|  2.3442e-06     	|  20000          	|  0.046884       	|  0.0023927      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_optimizer_step           	|  2.3122e-06     	|  20000          	|  0.046245       	|  0.00236        	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_after_backward                  	|  2.283e-06      	|  20000          	|  0.04566        	|  0.0023302      	|
|  [Callback]GradientAccumulationScheduler.on_after_backward                                                                                                                                                  	|  2.1843e-06     	|  20000          	|  0.043686       	|  0.0022294      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_batch_end                       	|  2.1663e-06     	|  20000          	|  0.043327       	|  0.0022111      	|
|  [Callback]GradientAccumulationScheduler.on_before_optimizer_step                                                                                                                                           	|  2.1542e-06     	|  20000          	|  0.043083       	|  0.0021987      	|
|  [Callback]GradientAccumulationScheduler.on_before_zero_grad                                                                                                                                                	|  2.1335e-06     	|  20000          	|  0.042669       	|  0.0021775      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_zero_grad                	|  2.0898e-06     	|  20000          	|  0.041796       	|  0.002133       	|
|  [Callback]GradientAccumulationScheduler.on_batch_end                                                                                                                                                       	|  2.0878e-06     	|  20000          	|  0.041755       	|  0.0021309      	|
|  [Callback]GradientAccumulationScheduler.on_before_backward                                                                                                                                                 	|  1.9928e-06     	|  20000          	|  0.039856       	|  0.002034       	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_backward                 	|  1.9807e-06     	|  20000          	|  0.039615       	|  0.0020217      	|
|  [LightningModule]NeRFSystem.on_before_batch_transfer                                                                                                                                                       	|  1.4775e-06     	|  20048          	|  0.02962        	|  0.0015116      	|
|  [LightningModule]NeRFSystem.training_step_end                                                                                                                                                              	|  1.3362e-06     	|  20000          	|  0.026724       	|  0.0013638      	|
|  [LightningModule]NeRFSystem.on_after_batch_transfer                                                                                                                                                        	|  1.266e-06      	|  20048          	|  0.02538        	|  0.0012952      	|
|  [LightningModule]NeRFSystem.on_train_batch_end                                                                                                                                                             	|  1.2181e-06     	|  20000          	|  0.024362       	|  0.0012433      	|
|  [LightningModule]NeRFSystem.on_train_batch_start                                                                                                                                                           	|  1.0994e-06     	|  20000          	|  0.021988       	|  0.0011221      	|
|  [Strategy]SingleDeviceStrategy.training_step_end                                                                                                                                                           	|  1.0899e-06     	|  20000          	|  0.021797       	|  0.0011124      	|
|  [Callback]TQDMProgressBar.on_validation_batch_end                                                                                                                                                          	|  0.00045311     	|  48             	|  0.021749       	|  0.0011099      	|
|  [LightningModule]NeRFSystem.on_before_zero_grad                                                                                                                                                            	|  1.0106e-06     	|  20000          	|  0.020213       	|  0.0010315      	|
|  [LightningModule]NeRFSystem.on_before_backward                                                                                                                                                             	|  9.8958e-07     	|  20000          	|  0.019792       	|  0.00101        	|
|  [LightningModule]NeRFSystem.on_before_optimizer_step                                                                                                                                                       	|  9.835e-07      	|  20000          	|  0.01967        	|  0.0010038      	|
|  [Strategy]SingleDeviceStrategy.on_train_batch_start                                                                                                                                                        	|  9.6676e-07     	|  20000          	|  0.019335       	|  0.00098674     	|
|  [LightningModule]NeRFSystem.on_after_backward                                                                                                                                                              	|  9.427e-07      	|  20000          	|  0.018854       	|  0.00096218     	|
|  [LightningModule]NeRFSystem.validation_epoch_end                                                                                                                                                           	|  0.0035873      	|  2              	|  0.0071747      	|  0.00036615     	|
|  [Callback]TQDMProgressBar.on_train_epoch_start                                                                                                                                                             	|  0.00023669     	|  20             	|  0.0047337      	|  0.00024158     	|
|  [Callback]TQDMProgressBar.on_train_epoch_end                                                                                                                                                               	|  0.00022685     	|  20             	|  0.0045371      	|  0.00023154     	|
|  [LightningModule]NeRFSystem.configure_optimizers                                                                                                                                                           	|  0.004012       	|  1              	|  0.004012       	|  0.00020475     	|
|  [LightningModule]NeRFSystem.lr_scheduler_step                                                                                                                                                              	|  0.00010653     	|  20             	|  0.0021305      	|  0.00010873     	|
|  [Callback]TQDMProgressBar.on_validation_batch_start                                                                                                                                                        	|  3.5836e-05     	|  48             	|  0.0017201      	|  8.7783e-05     	|
|  [LightningModule]NeRFSystem.on_validation_model_train                                                                                                                                                      	|  0.00057679     	|  2              	|  0.0011536      	|  5.8871e-05     	|
|  [LightningModule]NeRFSystem.on_validation_model_eval                                                                                                                                                       	|  0.00045572     	|  2              	|  0.00091143     	|  4.6513e-05     	|
|  [Callback]TQDMProgressBar.on_validation_end                                                                                                                                                                	|  0.00043201     	|  2              	|  0.00086401     	|  4.4093e-05     	|
|  [LightningModule]NeRFSystem.train_dataloader                                                                                                                                                               	|  0.00048449     	|  1              	|  0.00048449     	|  2.4725e-05     	|
|  [Callback]TQDMProgressBar.on_validation_start                                                                                                                                                              	|  0.00023148     	|  2              	|  0.00046296     	|  2.3626e-05     	|
|  [Callback]TQDMProgressBar.on_train_end                                                                                                                                                                     	|  0.00044397     	|  1              	|  0.00044397     	|  2.2657e-05     	|
|  [LightningModule]NeRFSystem.val_dataloader                                                                                                                                                                 	|  0.00032293     	|  1              	|  0.00032293     	|  1.648e-05      	|
|  [Callback]GradientAccumulationScheduler.on_validation_batch_end                                                                                                                                            	|  6.0574e-06     	|  48             	|  0.00029076     	|  1.4838e-05     	|
|  [Callback]TQDMProgressBar.on_train_start                                                                                                                                                                   	|  0.00027807     	|  1              	|  0.00027807     	|  1.4191e-05     	|
|  [Callback]GradientAccumulationScheduler.on_validation_batch_start                                                                                                                                          	|  3.4747e-06     	|  48             	|  0.00016679     	|  8.5117e-06     	|
|  [LightningModule]NeRFSystem.validation_step_end                                                                                                                                                            	|  3.0461e-06     	|  48             	|  0.00014621     	|  7.4616e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_batch_end            	|  2.8865e-06     	|  48             	|  0.00013855     	|  7.0708e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_batch_start          	|  2.6318e-06     	|  48             	|  0.00012633     	|  6.4468e-06     	|
|  [Callback]GradientAccumulationScheduler.on_train_epoch_start                                                                                                                                               	|  5.6935e-06     	|  20             	|  0.00011387     	|  5.8111e-06     	|
|  [LightningModule]NeRFSystem.on_validation_batch_end                                                                                                                                                        	|  2.2492e-06     	|  48             	|  0.00010796     	|  5.5095e-06     	|
|  [Callback]GradientAccumulationScheduler.on_train_epoch_end                                                                                                                                                 	|  4.589e-06      	|  20             	|  9.178e-05      	|  4.6838e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_end                  	|  3.9139e-05     	|  2              	|  7.8279e-05     	|  3.9948e-06     	|
|  [LightningModule]NeRFSystem.on_validation_batch_start                                                                                                                                                      	|  1.6157e-06     	|  48             	|  7.7556e-05     	|  3.9579e-06     	|
|  [Callback]TQDMProgressBar.on_epoch_start                                                                                                                                                                   	|  3.2686e-06     	|  22             	|  7.1908e-05     	|  3.6697e-06     	|
|  [Callback]TQDMProgressBar.on_epoch_end                                                                                                                                                                     	|  2.8396e-06     	|  22             	|  6.247e-05      	|  3.1881e-06     	|
|  [Strategy]SingleDeviceStrategy.validation_step_end                                                                                                                                                         	|  1.2304e-06     	|  48             	|  5.906e-05      	|  3.014e-06      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_epoch_start               	|  2.7854e-06     	|  20             	|  5.5707e-05     	|  2.8429e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_end                                                                                                                                                             	|  2.3054e-06     	|  20             	|  4.6109e-05     	|  2.3531e-06     	|
|  [Callback]GradientAccumulationScheduler.on_epoch_start                                                                                                                                                     	|  2.0569e-06     	|  22             	|  4.5251e-05     	|  2.3093e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_epoch_end                       	|  2.0172e-06     	|  22             	|  4.4378e-05     	|  2.2648e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_epoch_start                     	|  2.0077e-06     	|  22             	|  4.417e-05      	|  2.2541e-06     	|
|  [Callback]GradientAccumulationScheduler.on_epoch_end                                                                                                                                                       	|  1.946e-06      	|  22             	|  4.2811e-05     	|  2.1848e-06     	|
|  [LightningModule]NeRFSystem.on_epoch_end                                                                                                                                                                   	|  1.3377e-06     	|  22             	|  2.9429e-05     	|  1.5019e-06     	|
|  [LightningModule]NeRFSystem.on_epoch_start                                                                                                                                                                 	|  1.3314e-06     	|  22             	|  2.929e-05      	|  1.4948e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.setup                              	|  2.8749e-05     	|  1              	|  2.8749e-05     	|  1.4672e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_start                                                                                                                                                           	|  1.3692e-06     	|  20             	|  2.7385e-05     	|  1.3975e-06     	|
|  [Callback]GradientAccumulationScheduler.on_validation_end                                                                                                                                                  	|  9.5749e-06     	|  2              	|  1.915e-05      	|  9.7728e-07     	|
|  [LightningModule]NeRFSystem.on_validation_epoch_end                                                                                                                                                        	|  6.0699e-06     	|  2              	|  1.214e-05      	|  6.1953e-07     	|
|  [Strategy]SingleDeviceStrategy.on_validation_end                                                                                                                                                           	|  6.0149e-06     	|  2              	|  1.203e-05      	|  6.1392e-07     	|
|  [LightningModule]NeRFSystem.configure_callbacks                                                                                                                                                            	|  9.8897e-06     	|  1              	|  9.8897e-06     	|  5.047e-07      	|
|  [Callback]GradientAccumulationScheduler.on_validation_start                                                                                                                                                	|  4.2999e-06     	|  2              	|  8.5998e-06     	|  4.3888e-07     	|
|  [Callback]TQDMProgressBar.setup                                                                                                                                                                            	|  7.2997e-06     	|  1              	|  7.2997e-06     	|  3.7253e-07     	|
|  [Callback]TQDMProgressBar.on_validation_epoch_end                                                                                                                                                          	|  3.6252e-06     	|  2              	|  7.2503e-06     	|  3.7001e-07     	|
|  [Callback]TQDMProgressBar.on_fit_end                                                                                                                                                                       	|  6.8406e-06     	|  1              	|  6.8406e-06     	|  3.491e-07      	|
|  [Callback]TQDMProgressBar.on_validation_epoch_start                                                                                                                                                        	|  2.705e-06      	|  2              	|  5.4101e-06     	|  2.7609e-07     	|
|  [Callback]GradientAccumulationScheduler.on_train_start                                                                                                                                                     	|  4.8997e-06     	|  1              	|  4.8997e-06     	|  2.5005e-07     	|
|  [Callback]GradientAccumulationScheduler.on_train_end                                                                                                                                                       	|  4.5607e-06     	|  1              	|  4.5607e-06     	|  2.3275e-07     	|
|  [Callback]TQDMProgressBar.on_fit_start                                                                                                                                                                     	|  4.5002e-06     	|  1              	|  4.5002e-06     	|  2.2966e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_start                	|  2.19e-06       	|  2              	|  4.38e-06       	|  2.2353e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_epoch_start                                                                                                                                          	|  2.1751e-06     	|  2              	|  4.3502e-06     	|  2.2201e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_epoch_start          	|  2.1751e-06     	|  2              	|  4.3502e-06     	|  2.2201e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_start                     	|  4.3195e-06     	|  1              	|  4.3195e-06     	|  2.2044e-07     	|
|  [Callback]TQDMProgressBar.on_pretrain_routine_start                                                                                                                                                        	|  4.2003e-06     	|  1              	|  4.2003e-06     	|  2.1435e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_epoch_end                                                                                                                                            	|  2.0848e-06     	|  2              	|  4.1695e-06     	|  2.1278e-07     	|
|  [Callback]TQDMProgressBar.on_configure_sharded_model                                                                                                                                                       	|  3.96e-06       	|  1              	|  3.96e-06       	|  2.0209e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_epoch_end            	|  1.9651e-06     	|  2              	|  3.9302e-06     	|  2.0057e-07     	|
|  [Strategy]SingleDeviceStrategy.on_validation_start                                                                                                                                                         	|  1.9297e-06     	|  2              	|  3.8594e-06     	|  1.9696e-07     	|
|  [Callback]TQDMProgressBar.on_before_accelerator_backend_setup                                                                                                                                              	|  3.5595e-06     	|  1              	|  3.5595e-06     	|  1.8165e-07     	|
|  [Callback]GradientAccumulationScheduler.on_fit_start                                                                                                                                                       	|  3.4496e-06     	|  1              	|  3.4496e-06     	|  1.7605e-07     	|
|  [Callback]GradientAccumulationScheduler.on_before_accelerator_backend_setup                                                                                                                                	|  3.0398e-06     	|  1              	|  3.0398e-06     	|  1.5513e-07     	|
|  [Callback]GradientAccumulationScheduler.setup                                                                                                                                                              	|  3.0296e-06     	|  1              	|  3.0296e-06     	|  1.5461e-07     	|
|  [Callback]TQDMProgressBar.teardown                                                                                                                                                                         	|  3.01e-06       	|  1              	|  3.01e-06       	|  1.5361e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_accelerator_backend_setup	|  2.9802e-06     	|  1              	|  2.9802e-06     	|  1.5209e-07     	|
|  [Callback]GradientAccumulationScheduler.on_configure_sharded_model                                                                                                                                         	|  2.8806e-06     	|  1              	|  2.8806e-06     	|  1.4701e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_configure_sharded_model         	|  2.8303e-06     	|  1              	|  2.8303e-06     	|  1.4444e-07     	|
|  [LightningModule]NeRFSystem.on_validation_epoch_start                                                                                                                                                      	|  1.3849e-06     	|  2              	|  2.7698e-06     	|  1.4135e-07     	|
|  [LightningModule]NeRFSystem.on_validation_end                                                                                                                                                              	|  1.3155e-06     	|  2              	|  2.631e-06      	|  1.3427e-07     	|
|  [Callback]TQDMProgressBar.on_pretrain_routine_end                                                                                                                                                          	|  2.5202e-06     	|  1              	|  2.5202e-06     	|  1.2861e-07     	|
|  [Callback]GradientAccumulationScheduler.on_pretrain_routine_start                                                                                                                                          	|  2.3302e-06     	|  1              	|  2.3302e-06     	|  1.1892e-07     	|
|  [LightningModule]NeRFSystem.configure_sharded_model                                                                                                                                                        	|  2.2799e-06     	|  1              	|  2.2799e-06     	|  1.1635e-07     	|
|  [LightningModule]NeRFSystem.on_save_checkpoint                                                                                                                                                             	|  2.2603e-06     	|  1              	|  2.2603e-06     	|  1.1535e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_fit_start                       	|  2.2501e-06     	|  1              	|  2.2501e-06     	|  1.1483e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_pretrain_routine_start          	|  2.2296e-06     	|  1              	|  2.2296e-06     	|  1.1378e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_end                       	|  2.2193e-06     	|  1              	|  2.2193e-06     	|  1.1326e-07     	|
|  [Callback]GradientAccumulationScheduler.on_fit_end                                                                                                                                                         	|  2.2193e-06     	|  1              	|  2.2193e-06     	|  1.1326e-07     	|
|  [Callback]GradientAccumulationScheduler.teardown                                                                                                                                                           	|  2.1597e-06     	|  1              	|  2.1597e-06     	|  1.1022e-07     	|
|  [LightningModule]NeRFSystem.on_fit_start                                                                                                                                                                   	|  2.1495e-06     	|  1              	|  2.1495e-06     	|  1.097e-07      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_fit_end                         	|  2.0601e-06     	|  1              	|  2.0601e-06     	|  1.0513e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.teardown                           	|  2.02e-06       	|  1              	|  2.02e-06       	|  1.0309e-07     	|
|  [Callback]GradientAccumulationScheduler.on_pretrain_routine_end                                                                                                                                            	|  1.98e-06       	|  1              	|  1.98e-06       	|  1.0105e-07     	|
|  [LightningModule]NeRFSystem.prepare_data                                                                                                                                                                   	|  1.9399e-06     	|  1              	|  1.9399e-06     	|  9.9002e-08     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_pretrain_routine_end            	|  1.9399e-06     	|  1              	|  1.9399e-06     	|  9.9002e-08     	|
|  [LightningModule]NeRFSystem.on_fit_end                                                                                                                                                                     	|  1.8105e-06     	|  1              	|  1.8105e-06     	|  9.2395e-08     	|
|  [LightningModule]NeRFSystem.on_train_end                                                                                                                                                                   	|  1.6792e-06     	|  1              	|  1.6792e-06     	|  8.5694e-08     	|
|  [LightningModule]NeRFSystem.teardown                                                                                                                                                                       	|  1.6699e-06     	|  1              	|  1.6699e-06     	|  8.5218e-08     	|
|  [LightningModule]NeRFSystem.on_pretrain_routine_start                                                                                                                                                      	|  1.6196e-06     	|  1              	|  1.6196e-06     	|  8.2652e-08     	|
|  [Strategy]SingleDeviceStrategy.on_train_start                                                                                                                                                              	|  1.4203e-06     	|  1              	|  1.4203e-06     	|  7.2481e-08     	|
|  [LightningModule]NeRFSystem.on_train_start                                                                                                                                                                 	|  1.2005e-06     	|  1              	|  1.2005e-06     	|  6.1264e-08     	|
|  [LightningModule]NeRFSystem.on_pretrain_routine_end                                                                                                                                                        	|  1.1697e-06     	|  1              	|  1.1697e-06     	|  5.9696e-08     	|
|  [Strategy]SingleDeviceStrategy.on_train_end                                                                                                                                                                	|  9.7975e-07     	|  1              	|  9.7975e-07     	|  5e-08          	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
