FIT Profiler Report

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Action                                                                                                                                                                                                     	|  Mean duration (s)	|  Num calls      	|  Total time (s) 	|  Percentage %   	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Total                                                                                                                                                                                                      	|  -              	|  881649         	|  1338.6         	|  100 %          	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  run_training_epoch                                                                                                                                                                                         	|  63.545         	|  20             	|  1270.9         	|  94.941         	|
|  run_training_batch                                                                                                                                                                                         	|  0.053091       	|  20000          	|  1061.8         	|  79.322         	|
|  [LightningModule]NeRFSystem.optimizer_step                                                                                                                                                                 	|  0.052669       	|  20000          	|  1053.4         	|  78.691         	|
|  [Strategy]SingleDeviceStrategy.training_step                                                                                                                                                               	|  0.019375       	|  20000          	|  387.49         	|  28.947         	|
|  [TrainingEpochLoop].train_dataloader_next                                                                                                                                                                  	|  0.0069958      	|  20000          	|  139.92         	|  10.452         	|
|  [Strategy]SingleDeviceStrategy.backward                                                                                                                                                                    	|  0.0048151      	|  20000          	|  96.302         	|  7.1941         	|
|  [LightningModule]NeRFSystem.setup                                                                                                                                                                          	|  56.448         	|  1              	|  56.448         	|  4.2168         	|
|  [Strategy]SingleDeviceStrategy.validation_step                                                                                                                                                             	|  0.52616        	|  74             	|  38.936         	|  2.9086         	|
|  [Callback]TQDMProgressBar.on_train_batch_end                                                                                                                                                               	|  0.00055268     	|  20000          	|  11.054         	|  0.82574        	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_epoch_end                 	|  0.17906        	|  20             	|  3.5811         	|  0.26752        	|
|  [Strategy]SingleDeviceStrategy.batch_to_device                                                                                                                                                             	|  0.0001734      	|  20074          	|  3.4809         	|  0.26004        	|
|  [LightningModule]NeRFSystem.transfer_batch_to_device                                                                                                                                                       	|  0.000113       	|  20074          	|  2.2684         	|  0.16946        	|
|  [LightningModule]NeRFSystem.optimizer_zero_grad                                                                                                                                                            	|  3.4796e-05     	|  20000          	|  0.69591        	|  0.051987       	|
|  [EvaluationEpochLoop].val_dataloader_idx_0_next                                                                                                                                                            	|  0.0062472      	|  74             	|  0.46229        	|  0.034535       	|
|  [LightningModule]NeRFSystem.configure_gradient_clipping                                                                                                                                                    	|  2.1484e-05     	|  20000          	|  0.42969        	|  0.032099       	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_batch_end                 	|  1.9791e-05     	|  20000          	|  0.39581        	|  0.029569       	|
|  [LightningModule]NeRFSystem.on_validation_start                                                                                                                                                            	|  0.05655        	|  2              	|  0.1131         	|  0.008449       	|
|  [Callback]GradientAccumulationScheduler.on_train_batch_end                                                                                                                                                 	|  5.2834e-06     	|  20000          	|  0.10567        	|  0.0078937      	|
|  [Callback]TQDMProgressBar.on_after_backward                                                                                                                                                                	|  4.6166e-06     	|  20000          	|  0.092332       	|  0.0068975      	|
|  [Callback]TQDMProgressBar.on_before_optimizer_step                                                                                                                                                         	|  3.8874e-06     	|  20000          	|  0.077747       	|  0.005808       	|
|  [Callback]TQDMProgressBar.on_batch_start                                                                                                                                                                   	|  3.7629e-06     	|  20000          	|  0.075257       	|  0.005622       	|
|  [Callback]TQDMProgressBar.on_before_zero_grad                                                                                                                                                              	|  3.3699e-06     	|  20000          	|  0.067398       	|  0.0050349      	|
|  [Callback]TQDMProgressBar.on_before_backward                                                                                                                                                               	|  3.3695e-06     	|  20000          	|  0.06739        	|  0.0050343      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_batch_start                     	|  3.2027e-06     	|  20000          	|  0.064055       	|  0.0047851      	|
|  [Callback]TQDMProgressBar.on_train_batch_start                                                                                                                                                             	|  3.1545e-06     	|  20000          	|  0.06309        	|  0.004713       	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_optimizer_step           	|  2.8813e-06     	|  20000          	|  0.057626       	|  0.0043049      	|
|  [Callback]TQDMProgressBar.on_batch_end                                                                                                                                                                     	|  2.7753e-06     	|  20000          	|  0.055506       	|  0.0041465      	|
|  [Callback]GradientAccumulationScheduler.on_batch_start                                                                                                                                                     	|  2.6542e-06     	|  20000          	|  0.053084       	|  0.0039656      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_zero_grad                	|  2.5618e-06     	|  20000          	|  0.051236       	|  0.0038275      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_after_backward                  	|  2.5156e-06     	|  20000          	|  0.050313       	|  0.0037585      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_batch_start               	|  2.5091e-06     	|  20000          	|  0.050181       	|  0.0037487      	|
|  [LightningModule]NeRFSystem.on_before_batch_transfer                                                                                                                                                       	|  2.4984e-06     	|  20074          	|  0.050154       	|  0.0037467      	|
|  [Callback]GradientAccumulationScheduler.on_train_batch_start                                                                                                                                               	|  2.5027e-06     	|  20000          	|  0.050054       	|  0.0037393      	|
|  [Callback]GradientAccumulationScheduler.on_batch_end                                                                                                                                                       	|  2.4601e-06     	|  20000          	|  0.049202       	|  0.0036756      	|
|  [Callback]GradientAccumulationScheduler.on_after_backward                                                                                                                                                  	|  2.4332e-06     	|  20000          	|  0.048665       	|  0.0036354      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_batch_end                       	|  2.4026e-06     	|  20000          	|  0.048052       	|  0.0035897      	|
|  [Callback]GradientAccumulationScheduler.on_before_optimizer_step                                                                                                                                           	|  2.3814e-06     	|  20000          	|  0.047628       	|  0.003558       	|
|  [Callback]GradientAccumulationScheduler.on_before_zero_grad                                                                                                                                                	|  2.369e-06      	|  20000          	|  0.047379       	|  0.0035394      	|
|  [Callback]GradientAccumulationScheduler.on_before_backward                                                                                                                                                 	|  2.1248e-06     	|  20000          	|  0.042496       	|  0.0031746      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_backward                 	|  2.1014e-06     	|  20000          	|  0.042028       	|  0.0031397      	|
|  [LightningModule]NeRFSystem.on_train_batch_start                                                                                                                                                           	|  1.9187e-06     	|  20000          	|  0.038374       	|  0.0028667      	|
|  [LightningModule]NeRFSystem.on_after_batch_transfer                                                                                                                                                        	|  1.6974e-06     	|  20074          	|  0.034073       	|  0.0025454      	|
|  [Callback]TQDMProgressBar.on_validation_batch_end                                                                                                                                                          	|  0.00042856     	|  74             	|  0.031713       	|  0.0023691      	|
|  [LightningModule]NeRFSystem.training_step_end                                                                                                                                                              	|  1.5535e-06     	|  20000          	|  0.031069       	|  0.002321       	|
|  [Strategy]SingleDeviceStrategy.on_train_batch_start                                                                                                                                                        	|  1.4486e-06     	|  20000          	|  0.028972       	|  0.0021643      	|
|  [LightningModule]NeRFSystem.on_after_backward                                                                                                                                                              	|  1.3743e-06     	|  20000          	|  0.027486       	|  0.0020533      	|
|  [LightningModule]NeRFSystem.on_train_batch_end                                                                                                                                                             	|  1.3317e-06     	|  20000          	|  0.026634       	|  0.0019896      	|
|  [Strategy]SingleDeviceStrategy.training_step_end                                                                                                                                                           	|  1.2901e-06     	|  20000          	|  0.025801       	|  0.0019275      	|
|  [LightningModule]NeRFSystem.on_before_zero_grad                                                                                                                                                            	|  1.2503e-06     	|  20000          	|  0.025006       	|  0.0018681      	|
|  [LightningModule]NeRFSystem.on_before_optimizer_step                                                                                                                                                       	|  1.1808e-06     	|  20000          	|  0.023617       	|  0.0017643      	|
|  [LightningModule]NeRFSystem.on_before_backward                                                                                                                                                             	|  1.1228e-06     	|  20000          	|  0.022456       	|  0.0016775      	|
|  [LightningModule]NeRFSystem.validation_epoch_end                                                                                                                                                           	|  0.0062548      	|  2              	|  0.01251        	|  0.00093451     	|
|  [Callback]TQDMProgressBar.on_train_epoch_start                                                                                                                                                             	|  0.00032883     	|  20             	|  0.0065766      	|  0.0004913      	|
|  [Callback]TQDMProgressBar.on_train_epoch_end                                                                                                                                                               	|  0.00026204     	|  20             	|  0.0052408      	|  0.00039151     	|
|  [LightningModule]NeRFSystem.configure_optimizers                                                                                                                                                           	|  0.0045063      	|  1              	|  0.0045063      	|  0.00033664     	|
|  [Callback]TQDMProgressBar.on_validation_batch_start                                                                                                                                                        	|  4.4113e-05     	|  74             	|  0.0032643      	|  0.00024386     	|
|  [Callback]TQDMProgressBar.on_validation_end                                                                                                                                                                	|  0.0011567      	|  2              	|  0.0023134      	|  0.00017282     	|
|  [LightningModule]NeRFSystem.lr_scheduler_step                                                                                                                                                              	|  0.00010965     	|  20             	|  0.0021931      	|  0.00016383     	|
|  [LightningModule]NeRFSystem.on_validation_model_eval                                                                                                                                                       	|  0.00061471     	|  2              	|  0.0012294      	|  9.1842e-05     	|
|  [LightningModule]NeRFSystem.on_validation_model_train                                                                                                                                                      	|  0.00055022     	|  2              	|  0.0011004      	|  8.2207e-05     	|
|  [LightningModule]NeRFSystem.train_dataloader                                                                                                                                                               	|  0.0006676      	|  1              	|  0.0006676      	|  4.9872e-05     	|
|  [Callback]TQDMProgressBar.on_validation_start                                                                                                                                                              	|  0.00032707     	|  2              	|  0.00065413     	|  4.8866e-05     	|
|  [Callback]GradientAccumulationScheduler.on_validation_batch_end                                                                                                                                            	|  5.8615e-06     	|  74             	|  0.00043375     	|  3.2403e-05     	|
|  [Callback]TQDMProgressBar.on_train_start                                                                                                                                                                   	|  0.00035921     	|  1              	|  0.00035921     	|  2.6834e-05     	|
|  [LightningModule]NeRFSystem.val_dataloader                                                                                                                                                                 	|  0.00033484     	|  1              	|  0.00033484     	|  2.5014e-05     	|
|  [Callback]TQDMProgressBar.on_train_end                                                                                                                                                                     	|  0.00029855     	|  1              	|  0.00029855     	|  2.2303e-05     	|
|  [Callback]GradientAccumulationScheduler.on_validation_batch_start                                                                                                                                          	|  3.275e-06      	|  74             	|  0.00024235     	|  1.8104e-05     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_batch_end            	|  2.9673e-06     	|  74             	|  0.00021958     	|  1.6403e-05     	|
|  [LightningModule]NeRFSystem.validation_step_end                                                                                                                                                            	|  2.8366e-06     	|  74             	|  0.00020991     	|  1.5681e-05     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_batch_start          	|  2.5293e-06     	|  74             	|  0.00018717     	|  1.3982e-05     	|
|  [Callback]GradientAccumulationScheduler.on_train_epoch_start                                                                                                                                               	|  6.8028e-06     	|  20             	|  0.00013606     	|  1.0164e-05     	|
|  [LightningModule]NeRFSystem.on_validation_batch_end                                                                                                                                                        	|  1.8261e-06     	|  74             	|  0.00013513     	|  1.0095e-05     	|
|  [Callback]TQDMProgressBar.on_epoch_start                                                                                                                                                                   	|  4.7697e-06     	|  22             	|  0.00010493     	|  7.8389e-06     	|
|  [LightningModule]NeRFSystem.on_validation_batch_start                                                                                                                                                      	|  1.4126e-06     	|  74             	|  0.00010453     	|  7.8088e-06     	|
|  [Callback]GradientAccumulationScheduler.on_train_epoch_end                                                                                                                                                 	|  4.9464e-06     	|  20             	|  9.8929e-05     	|  7.3903e-06     	|
|  [Strategy]SingleDeviceStrategy.validation_step_end                                                                                                                                                         	|  1.3081e-06     	|  74             	|  9.6801e-05     	|  7.2314e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_end                  	|  4.8054e-05     	|  2              	|  9.6109e-05     	|  7.1797e-06     	|
|  [Callback]TQDMProgressBar.on_epoch_end                                                                                                                                                                     	|  3.2263e-06     	|  22             	|  7.0978e-05     	|  5.3023e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_epoch_start               	|  3.1994e-06     	|  20             	|  6.3987e-05     	|  4.7801e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.setup                              	|  5.6339e-05     	|  1              	|  5.6339e-05     	|  4.2088e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_epoch_end                       	|  2.3724e-06     	|  22             	|  5.2192e-05     	|  3.899e-06      	|
|  [Callback]GradientAccumulationScheduler.on_epoch_end                                                                                                                                                       	|  2.3681e-06     	|  22             	|  5.2099e-05     	|  3.892e-06      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_epoch_start                     	|  2.3058e-06     	|  22             	|  5.0728e-05     	|  3.7896e-06     	|
|  [Callback]GradientAccumulationScheduler.on_epoch_start                                                                                                                                                     	|  2.3041e-06     	|  22             	|  5.0691e-05     	|  3.7868e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_end                                                                                                                                                             	|  1.6705e-06     	|  20             	|  3.3409e-05     	|  2.4958e-06     	|
|  [LightningModule]NeRFSystem.on_epoch_end                                                                                                                                                                   	|  1.3859e-06     	|  22             	|  3.0489e-05     	|  2.2776e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_start                                                                                                                                                           	|  1.512e-06      	|  20             	|  3.0241e-05     	|  2.2591e-06     	|
|  [LightningModule]NeRFSystem.on_epoch_start                                                                                                                                                                 	|  1.3196e-06     	|  22             	|  2.9031e-05     	|  2.1687e-06     	|
|  [Callback]TQDMProgressBar.on_validation_epoch_end                                                                                                                                                          	|  1.1219e-05     	|  2              	|  2.2438e-05     	|  1.6762e-06     	|
|  [LightningModule]NeRFSystem.on_validation_epoch_end                                                                                                                                                        	|  7.8101e-06     	|  2              	|  1.562e-05      	|  1.1669e-06     	|
|  [Callback]GradientAccumulationScheduler.on_validation_end                                                                                                                                                  	|  6.7349e-06     	|  2              	|  1.347e-05      	|  1.0062e-06     	|
|  [Callback]GradientAccumulationScheduler.on_validation_start                                                                                                                                                	|  6.72e-06       	|  2              	|  1.344e-05      	|  1.004e-06      	|
|  [LightningModule]NeRFSystem.configure_callbacks                                                                                                                                                            	|  9.2797e-06     	|  1              	|  9.2797e-06     	|  6.9323e-07     	|
|  [Strategy]SingleDeviceStrategy.on_validation_end                                                                                                                                                           	|  4.265e-06      	|  2              	|  8.53e-06       	|  6.3722e-07     	|
|  [Callback]TQDMProgressBar.on_fit_end                                                                                                                                                                       	|  8.0597e-06     	|  1              	|  8.0597e-06     	|  6.0209e-07     	|
|  [Callback]TQDMProgressBar.setup                                                                                                                                                                            	|  7.6806e-06     	|  1              	|  7.6806e-06     	|  5.7377e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_start                	|  3.6298e-06     	|  2              	|  7.2597e-06     	|  5.4232e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_epoch_end                                                                                                                                            	|  3.3551e-06     	|  2              	|  6.7102e-06     	|  5.0128e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_epoch_end            	|  3.1749e-06     	|  2              	|  6.3498e-06     	|  4.7435e-07     	|
|  [Callback]TQDMProgressBar.on_validation_epoch_start                                                                                                                                                        	|  2.9653e-06     	|  2              	|  5.9307e-06     	|  4.4304e-07     	|
|  [Callback]TQDMProgressBar.on_pretrain_routine_start                                                                                                                                                        	|  5.7202e-06     	|  1              	|  5.7202e-06     	|  4.2732e-07     	|
|  [Callback]TQDMProgressBar.on_fit_start                                                                                                                                                                     	|  5.56e-06       	|  1              	|  5.56e-06       	|  4.1535e-07     	|
|  [Strategy]SingleDeviceStrategy.on_validation_start                                                                                                                                                         	|  2.6599e-06     	|  2              	|  5.3197e-06     	|  3.974e-07      	|
|  [Callback]GradientAccumulationScheduler.on_train_start                                                                                                                                                     	|  4.9695e-06     	|  1              	|  4.9695e-06     	|  3.7124e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_start                     	|  4.8699e-06     	|  1              	|  4.8699e-06     	|  3.638e-07      	|
|  [Callback]GradientAccumulationScheduler.on_fit_start                                                                                                                                                       	|  4.6706e-06     	|  1              	|  4.6706e-06     	|  3.4891e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_epoch_start                                                                                                                                          	|  2.2948e-06     	|  2              	|  4.5896e-06     	|  3.4286e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_epoch_start          	|  2.285e-06      	|  2              	|  4.57e-06       	|  3.414e-07      	|
|  [Callback]GradientAccumulationScheduler.on_train_end                                                                                                                                                       	|  4.2096e-06     	|  1              	|  4.2096e-06     	|  3.1447e-07     	|
|  [LightningModule]NeRFSystem.configure_sharded_model                                                                                                                                                        	|  4.15e-06       	|  1              	|  4.15e-06       	|  3.1002e-07     	|
|  [Callback]GradientAccumulationScheduler.setup                                                                                                                                                              	|  3.9004e-06     	|  1              	|  3.9004e-06     	|  2.9137e-07     	|
|  [Callback]TQDMProgressBar.on_before_accelerator_backend_setup                                                                                                                                              	|  3.8398e-06     	|  1              	|  3.8398e-06     	|  2.8685e-07     	|
|  [LightningModule]NeRFSystem.on_validation_end                                                                                                                                                              	|  1.8645e-06     	|  2              	|  3.729e-06      	|  2.7857e-07     	|
|  [LightningModule]NeRFSystem.on_save_checkpoint                                                                                                                                                             	|  3.1805e-06     	|  1              	|  3.1805e-06     	|  2.3759e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_accelerator_backend_setup	|  3.1106e-06     	|  1              	|  3.1106e-06     	|  2.3237e-07     	|
|  [Callback]GradientAccumulationScheduler.on_before_accelerator_backend_setup                                                                                                                                	|  3.0501e-06     	|  1              	|  3.0501e-06     	|  2.2785e-07     	|
|  [Callback]TQDMProgressBar.teardown                                                                                                                                                                         	|  2.9504e-06     	|  1              	|  2.9504e-06     	|  2.2041e-07     	|
|  [Callback]TQDMProgressBar.on_configure_sharded_model                                                                                                                                                       	|  2.9495e-06     	|  1              	|  2.9495e-06     	|  2.2034e-07     	|
|  [LightningModule]NeRFSystem.on_fit_start                                                                                                                                                                   	|  2.8806e-06     	|  1              	|  2.8806e-06     	|  2.1519e-07     	|
|  [LightningModule]NeRFSystem.on_validation_epoch_start                                                                                                                                                      	|  1.3695e-06     	|  2              	|  2.739e-06      	|  2.0461e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_fit_start                       	|  2.6403e-06     	|  1              	|  2.6403e-06     	|  1.9724e-07     	|
|  [Callback]TQDMProgressBar.on_pretrain_routine_end                                                                                                                                                          	|  2.5006e-06     	|  1              	|  2.5006e-06     	|  1.868e-07      	|
|  [Callback]GradientAccumulationScheduler.on_pretrain_routine_start                                                                                                                                          	|  2.4792e-06     	|  1              	|  2.4792e-06     	|  1.852e-07      	|
|  [Callback]GradientAccumulationScheduler.on_fit_end                                                                                                                                                         	|  2.3497e-06     	|  1              	|  2.3497e-06     	|  1.7553e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_configure_sharded_model         	|  2.3097e-06     	|  1              	|  2.3097e-06     	|  1.7254e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_pretrain_routine_start          	|  2.21e-06       	|  1              	|  2.21e-06       	|  1.651e-07      	|
|  [LightningModule]NeRFSystem.prepare_data                                                                                                                                                                   	|  2.1495e-06     	|  1              	|  2.1495e-06     	|  1.6058e-07     	|
|  [Callback]GradientAccumulationScheduler.on_configure_sharded_model                                                                                                                                         	|  2.1402e-06     	|  1              	|  2.1402e-06     	|  1.5988e-07     	|
|  [Callback]GradientAccumulationScheduler.teardown                                                                                                                                                           	|  2.1001e-06     	|  1              	|  2.1001e-06     	|  1.5689e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_end                       	|  2.0601e-06     	|  1              	|  2.0601e-06     	|  1.539e-07      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.teardown                           	|  2.0498e-06     	|  1              	|  2.0498e-06     	|  1.5313e-07     	|
|  [LightningModule]NeRFSystem.on_fit_end                                                                                                                                                                     	|  2.0098e-06     	|  1              	|  2.0098e-06     	|  1.5014e-07     	|
|  [LightningModule]NeRFSystem.on_pretrain_routine_end                                                                                                                                                        	|  2.0005e-06     	|  1              	|  2.0005e-06     	|  1.4944e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_fit_end                         	|  1.9697e-06     	|  1              	|  1.9697e-06     	|  1.4715e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_pretrain_routine_end            	|  1.9101e-06     	|  1              	|  1.9101e-06     	|  1.4269e-07     	|
|  [Callback]GradientAccumulationScheduler.on_pretrain_routine_end                                                                                                                                            	|  1.8794e-06     	|  1              	|  1.8794e-06     	|  1.404e-07      	|
|  [LightningModule]NeRFSystem.teardown                                                                                                                                                                       	|  1.7192e-06     	|  1              	|  1.7192e-06     	|  1.2843e-07     	|
|  [LightningModule]NeRFSystem.on_train_start                                                                                                                                                                 	|  1.5898e-06     	|  1              	|  1.5898e-06     	|  1.1876e-07     	|
|  [LightningModule]NeRFSystem.on_train_end                                                                                                                                                                   	|  1.4203e-06     	|  1              	|  1.4203e-06     	|  1.061e-07      	|
|  [Strategy]SingleDeviceStrategy.on_train_end                                                                                                                                                                	|  1.3206e-06     	|  1              	|  1.3206e-06     	|  9.8655e-08     	|
|  [Strategy]SingleDeviceStrategy.on_train_start                                                                                                                                                              	|  1.1995e-06     	|  1              	|  1.1995e-06     	|  8.961e-08      	|
|  [LightningModule]NeRFSystem.on_pretrain_routine_start                                                                                                                                                      	|  1.1297e-06     	|  1              	|  1.1297e-06     	|  8.4392e-08     	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
