FIT Profiler Report

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Action                                                                                                                                                                                                     	|  Mean duration (s)	|  Num calls      	|  Total time (s) 	|  Percentage %   	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Total                                                                                                                                                                                                      	|  -              	|  881073         	|  1331.2         	|  100 %          	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  run_training_epoch                                                                                                                                                                                         	|  65.545         	|  20             	|  1310.9         	|  98.478         	|
|  run_training_batch                                                                                                                                                                                         	|  0.058505       	|  20000          	|  1170.1         	|  87.901         	|
|  [LightningModule]NeRFSystem.optimizer_step                                                                                                                                                                 	|  0.05817        	|  20000          	|  1163.4         	|  87.397         	|
|  [Strategy]SingleDeviceStrategy.training_step                                                                                                                                                               	|  0.020002       	|  20000          	|  400.03         	|  30.052         	|
|  [Strategy]SingleDeviceStrategy.backward                                                                                                                                                                    	|  0.0047027      	|  20000          	|  94.054         	|  7.0656         	|
|  [TrainingEpochLoop].train_dataloader_next                                                                                                                                                                  	|  0.0042286      	|  20000          	|  84.573         	|  6.3533         	|
|  [Strategy]SingleDeviceStrategy.validation_step                                                                                                                                                             	|  0.83282        	|  38             	|  31.647         	|  2.3774         	|
|  [LightningModule]NeRFSystem.setup                                                                                                                                                                          	|  9.4791         	|  1              	|  9.4791         	|  0.7121         	|
|  [Callback]TQDMProgressBar.on_train_batch_end                                                                                                                                                               	|  0.00047324     	|  20000          	|  9.4647         	|  0.71102        	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_epoch_end                 	|  0.16684        	|  20             	|  3.3368         	|  0.25067        	|
|  [Strategy]SingleDeviceStrategy.batch_to_device                                                                                                                                                             	|  0.00013115     	|  20038          	|  2.628          	|  0.19742        	|
|  [LightningModule]NeRFSystem.transfer_batch_to_device                                                                                                                                                       	|  8.4837e-05     	|  20038          	|  1.7            	|  0.12771        	|
|  [LightningModule]NeRFSystem.optimizer_zero_grad                                                                                                                                                            	|  2.7081e-05     	|  20000          	|  0.54162        	|  0.040688       	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_batch_end                 	|  1.6008e-05     	|  20000          	|  0.32016        	|  0.024051       	|
|  [LightningModule]NeRFSystem.configure_gradient_clipping                                                                                                                                                    	|  1.5937e-05     	|  20000          	|  0.31875        	|  0.023945       	|
|  [EvaluationEpochLoop].val_dataloader_idx_0_next                                                                                                                                                            	|  0.0079624      	|  38             	|  0.30257        	|  0.02273        	|
|  [Callback]GradientAccumulationScheduler.on_train_batch_end                                                                                                                                                 	|  4.8603e-06     	|  20000          	|  0.097206       	|  0.0073024      	|
|  [LightningModule]NeRFSystem.on_validation_start                                                                                                                                                            	|  0.046235       	|  2              	|  0.092471       	|  0.0069467      	|
|  [Callback]TQDMProgressBar.on_after_backward                                                                                                                                                                	|  3.6446e-06     	|  20000          	|  0.072892       	|  0.0054759      	|
|  [Callback]TQDMProgressBar.on_before_optimizer_step                                                                                                                                                         	|  3.4544e-06     	|  20000          	|  0.069089       	|  0.0051901      	|
|  [Callback]TQDMProgressBar.on_batch_start                                                                                                                                                                   	|  3.43e-06       	|  20000          	|  0.068601       	|  0.0051535      	|
|  [Callback]TQDMProgressBar.on_train_batch_start                                                                                                                                                             	|  2.9653e-06     	|  20000          	|  0.059306       	|  0.0044553      	|
|  [Callback]TQDMProgressBar.on_before_zero_grad                                                                                                                                                              	|  2.9166e-06     	|  20000          	|  0.058333       	|  0.0043821      	|
|  [Callback]TQDMProgressBar.on_before_backward                                                                                                                                                               	|  2.8646e-06     	|  20000          	|  0.057292       	|  0.0043039      	|
|  [Callback]GradientAccumulationScheduler.on_batch_start                                                                                                                                                     	|  2.5386e-06     	|  20000          	|  0.050772       	|  0.0038142      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_batch_start                     	|  2.4592e-06     	|  20000          	|  0.049184       	|  0.0036948      	|
|  [Callback]TQDMProgressBar.on_batch_end                                                                                                                                                                     	|  2.3477e-06     	|  20000          	|  0.046955       	|  0.0035274      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_after_backward                  	|  2.3124e-06     	|  20000          	|  0.046248       	|  0.0034743      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_batch_start               	|  2.3084e-06     	|  20000          	|  0.046169       	|  0.0034683      	|
|  [Callback]GradientAccumulationScheduler.on_train_batch_start                                                                                                                                               	|  2.2662e-06     	|  20000          	|  0.045324       	|  0.0034049      	|
|  [Callback]GradientAccumulationScheduler.on_after_backward                                                                                                                                                  	|  2.1681e-06     	|  20000          	|  0.043363       	|  0.0032575      	|
|  [Callback]GradientAccumulationScheduler.on_before_optimizer_step                                                                                                                                           	|  2.159e-06      	|  20000          	|  0.043181       	|  0.0032439      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_optimizer_step           	|  2.1418e-06     	|  20000          	|  0.042835       	|  0.0032179      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_zero_grad                	|  2.1046e-06     	|  20000          	|  0.042092       	|  0.0031621      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_batch_end                       	|  2.0989e-06     	|  20000          	|  0.041978       	|  0.0031535      	|
|  [Callback]GradientAccumulationScheduler.on_before_zero_grad                                                                                                                                                	|  2.0871e-06     	|  20000          	|  0.041742       	|  0.0031358      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_backward                 	|  2.0337e-06     	|  20000          	|  0.040673       	|  0.0030555      	|
|  [Callback]GradientAccumulationScheduler.on_batch_end                                                                                                                                                       	|  2.0123e-06     	|  20000          	|  0.040246       	|  0.0030234      	|
|  [Callback]GradientAccumulationScheduler.on_before_backward                                                                                                                                                 	|  1.9411e-06     	|  20000          	|  0.038821       	|  0.0029164      	|
|  [LightningModule]NeRFSystem.on_after_batch_transfer                                                                                                                                                        	|  1.4255e-06     	|  20038          	|  0.028564       	|  0.0021458      	|
|  [LightningModule]NeRFSystem.on_before_batch_transfer                                                                                                                                                       	|  1.3683e-06     	|  20038          	|  0.027418       	|  0.0020597      	|
|  [LightningModule]NeRFSystem.training_step_end                                                                                                                                                              	|  1.2466e-06     	|  20000          	|  0.024932       	|  0.0018729      	|
|  [Strategy]SingleDeviceStrategy.training_step_end                                                                                                                                                           	|  1.1125e-06     	|  20000          	|  0.02225        	|  0.0016715      	|
|  [LightningModule]NeRFSystem.on_train_batch_end                                                                                                                                                             	|  1.0519e-06     	|  20000          	|  0.021039       	|  0.0015805      	|
|  [LightningModule]NeRFSystem.on_before_zero_grad                                                                                                                                                            	|  1.0398e-06     	|  20000          	|  0.020797       	|  0.0015623      	|
|  [LightningModule]NeRFSystem.on_before_backward                                                                                                                                                             	|  9.5194e-07     	|  20000          	|  0.019039       	|  0.0014302      	|
|  [LightningModule]NeRFSystem.on_train_batch_start                                                                                                                                                           	|  9.3206e-07     	|  20000          	|  0.018641       	|  0.0014004      	|
|  [LightningModule]NeRFSystem.on_before_optimizer_step                                                                                                                                                       	|  9.1362e-07     	|  20000          	|  0.018272       	|  0.0013727      	|
|  [LightningModule]NeRFSystem.on_after_backward                                                                                                                                                              	|  8.9642e-07     	|  20000          	|  0.017928       	|  0.0013468      	|
|  [Strategy]SingleDeviceStrategy.on_train_batch_start                                                                                                                                                        	|  8.7934e-07     	|  20000          	|  0.017587       	|  0.0013212      	|
|  [Callback]TQDMProgressBar.on_validation_batch_end                                                                                                                                                          	|  0.0004425      	|  38             	|  0.016815       	|  0.0012632      	|
|  [LightningModule]NeRFSystem.configure_optimizers                                                                                                                                                           	|  0.013593       	|  1              	|  0.013593       	|  0.0010211      	|
|  [LightningModule]NeRFSystem.validation_epoch_end                                                                                                                                                           	|  0.00429        	|  2              	|  0.0085799      	|  0.00064455     	|
|  [Callback]TQDMProgressBar.on_train_epoch_start                                                                                                                                                             	|  0.00025846     	|  20             	|  0.0051692      	|  0.00038832     	|
|  [Callback]TQDMProgressBar.on_train_epoch_end                                                                                                                                                               	|  0.00024603     	|  20             	|  0.0049207      	|  0.00036965     	|
|  [LightningModule]NeRFSystem.lr_scheduler_step                                                                                                                                                              	|  0.00010597     	|  20             	|  0.0021193      	|  0.00015921     	|
|  [Callback]TQDMProgressBar.on_validation_batch_start                                                                                                                                                        	|  5.0935e-05     	|  38             	|  0.0019355      	|  0.0001454      	|
|  [Callback]TQDMProgressBar.on_validation_end                                                                                                                                                                	|  0.00060684     	|  2              	|  0.0012137      	|  9.1175e-05     	|
|  [LightningModule]NeRFSystem.on_validation_model_train                                                                                                                                                      	|  0.00052871     	|  2              	|  0.0010574      	|  7.9436e-05     	|
|  [LightningModule]NeRFSystem.on_validation_model_eval                                                                                                                                                       	|  0.00049309     	|  2              	|  0.00098619     	|  7.4085e-05     	|
|  [LightningModule]NeRFSystem.train_dataloader                                                                                                                                                               	|  0.00064396     	|  1              	|  0.00064396     	|  4.8376e-05     	|
|  [Callback]TQDMProgressBar.on_validation_start                                                                                                                                                              	|  0.00030042     	|  2              	|  0.00060084     	|  4.5137e-05     	|
|  [Callback]TQDMProgressBar.on_train_start                                                                                                                                                                   	|  0.00035704     	|  1              	|  0.00035704     	|  2.6822e-05     	|
|  [LightningModule]NeRFSystem.val_dataloader                                                                                                                                                                 	|  0.00029246     	|  1              	|  0.00029246     	|  2.197e-05      	|
|  [Callback]TQDMProgressBar.on_train_end                                                                                                                                                                     	|  0.00025612     	|  1              	|  0.00025612     	|  1.924e-05      	|
|  [Callback]GradientAccumulationScheduler.on_validation_batch_end                                                                                                                                            	|  5.7367e-06     	|  38             	|  0.00021799     	|  1.6376e-05     	|
|  [Callback]GradientAccumulationScheduler.on_train_epoch_end                                                                                                                                                 	|  7.304e-06      	|  20             	|  0.00014608     	|  1.0974e-05     	|
|  [LightningModule]NeRFSystem.validation_step_end                                                                                                                                                            	|  3.7375e-06     	|  38             	|  0.00014202     	|  1.0669e-05     	|
|  [Callback]GradientAccumulationScheduler.on_validation_batch_start                                                                                                                                          	|  3.49e-06       	|  38             	|  0.00013262     	|  9.9629e-06     	|
|  [Callback]GradientAccumulationScheduler.on_train_epoch_start                                                                                                                                               	|  5.833e-06      	|  20             	|  0.00011666     	|  8.7638e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_batch_start          	|  2.9573e-06     	|  38             	|  0.00011238     	|  8.4422e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_batch_end            	|  2.8717e-06     	|  38             	|  0.00010912     	|  8.1978e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_end                  	|  4.8734e-05     	|  2              	|  9.7468e-05     	|  7.3221e-06     	|
|  [Callback]TQDMProgressBar.on_epoch_start                                                                                                                                                                   	|  4.3985e-06     	|  22             	|  9.6767e-05     	|  7.2694e-06     	|
|  [LightningModule]NeRFSystem.on_validation_batch_end                                                                                                                                                        	|  1.8927e-06     	|  38             	|  7.1923e-05     	|  5.4031e-06     	|
|  [Callback]TQDMProgressBar.on_epoch_end                                                                                                                                                                     	|  3.0614e-06     	|  22             	|  6.7351e-05     	|  5.0596e-06     	|
|  [LightningModule]NeRFSystem.on_validation_batch_start                                                                                                                                                      	|  1.5571e-06     	|  38             	|  5.917e-05      	|  4.445e-06      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_epoch_start               	|  2.928e-06      	|  20             	|  5.856e-05      	|  4.3992e-06     	|
|  [Callback]GradientAccumulationScheduler.on_epoch_end                                                                                                                                                       	|  2.2746e-06     	|  22             	|  5.0041e-05     	|  3.7592e-06     	|
|  [Callback]GradientAccumulationScheduler.on_epoch_start                                                                                                                                                     	|  2.2555e-06     	|  22             	|  4.9621e-05     	|  3.7277e-06     	|
|  [Strategy]SingleDeviceStrategy.validation_step_end                                                                                                                                                         	|  1.3034e-06     	|  38             	|  4.953e-05      	|  3.7208e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_epoch_end                       	|  2.2172e-06     	|  22             	|  4.8779e-05     	|  3.6644e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_epoch_start                     	|  2.1837e-06     	|  22             	|  4.8041e-05     	|  3.609e-06      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.setup                              	|  3.2369e-05     	|  1              	|  3.2369e-05     	|  2.4316e-06     	|
|  [LightningModule]NeRFSystem.on_epoch_end                                                                                                                                                                   	|  1.4194e-06     	|  22             	|  3.1227e-05     	|  2.3459e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_end                                                                                                                                                             	|  1.4782e-06     	|  20             	|  2.9564e-05     	|  2.2209e-06     	|
|  [LightningModule]NeRFSystem.on_epoch_start                                                                                                                                                                 	|  1.3034e-06     	|  22             	|  2.8675e-05     	|  2.1542e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_start                                                                                                                                                           	|  1.3906e-06     	|  20             	|  2.7811e-05     	|  2.0892e-06     	|
|  [Callback]GradientAccumulationScheduler.on_validation_end                                                                                                                                                  	|  1.0685e-05     	|  2              	|  2.1369e-05     	|  1.6053e-06     	|
|  [Callback]TQDMProgressBar.on_validation_epoch_end                                                                                                                                                          	|  5.8999e-06     	|  2              	|  1.18e-05       	|  8.8644e-07     	|
|  [Strategy]SingleDeviceStrategy.on_validation_end                                                                                                                                                           	|  5.8096e-06     	|  2              	|  1.1619e-05     	|  8.7286e-07     	|
|  [LightningModule]NeRFSystem.on_validation_epoch_end                                                                                                                                                        	|  5.4697e-06     	|  2              	|  1.0939e-05     	|  8.2179e-07     	|
|  [LightningModule]NeRFSystem.configure_callbacks                                                                                                                                                            	|  1.0389e-05     	|  1              	|  1.0389e-05     	|  7.8044e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_start                                                                                                                                                	|  4.61e-06       	|  2              	|  9.2201e-06     	|  6.9264e-07     	|
|  [Callback]TQDMProgressBar.setup                                                                                                                                                                            	|  8.2701e-06     	|  1              	|  8.2701e-06     	|  6.2128e-07     	|
|  [Callback]TQDMProgressBar.on_fit_end                                                                                                                                                                       	|  7.8101e-06     	|  1              	|  7.8101e-06     	|  5.8671e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_epoch_end                                                                                                                                            	|  3.7453e-06     	|  2              	|  7.4906e-06     	|  5.6272e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_epoch_end            	|  3.6154e-06     	|  2              	|  7.2308e-06     	|  5.432e-07      	|
|  [Callback]TQDMProgressBar.on_validation_epoch_start                                                                                                                                                        	|  2.8452e-06     	|  2              	|  5.6904e-06     	|  4.2748e-07     	|
|  [Callback]GradientAccumulationScheduler.on_train_start                                                                                                                                                     	|  5.3197e-06     	|  1              	|  5.3197e-06     	|  3.9963e-07     	|
|  [Strategy]SingleDeviceStrategy.on_validation_start                                                                                                                                                         	|  2.6403e-06     	|  2              	|  5.2806e-06     	|  3.9669e-07     	|
|  [Callback]TQDMProgressBar.on_pretrain_routine_start                                                                                                                                                        	|  4.9397e-06     	|  1              	|  4.9397e-06     	|  3.7109e-07     	|
|  [Callback]TQDMProgressBar.on_fit_start                                                                                                                                                                     	|  4.7702e-06     	|  1              	|  4.7702e-06     	|  3.5835e-07     	|
|  [Callback]TQDMProgressBar.teardown                                                                                                                                                                         	|  4.5197e-06     	|  1              	|  4.5197e-06     	|  3.3953e-07     	|
|  [Callback]GradientAccumulationScheduler.on_train_end                                                                                                                                                       	|  4.4899e-06     	|  1              	|  4.4899e-06     	|  3.3729e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_start                     	|  4.3903e-06     	|  1              	|  4.3903e-06     	|  3.2981e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_epoch_start          	|  2.1346e-06     	|  2              	|  4.2692e-06     	|  3.2071e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_epoch_start                                                                                                                                          	|  2.1104e-06     	|  2              	|  4.2208e-06     	|  3.1707e-07     	|
|  [Callback]GradientAccumulationScheduler.on_fit_start                                                                                                                                                       	|  4.2198e-06     	|  1              	|  4.2198e-06     	|  3.17e-07       	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_start                	|  2.095e-06      	|  2              	|  4.19e-06       	|  3.1477e-07     	|
|  [LightningModule]NeRFSystem.on_validation_epoch_start                                                                                                                                                      	|  2.0298e-06     	|  2              	|  4.0596e-06     	|  3.0497e-07     	|
|  [Callback]GradientAccumulationScheduler.on_fit_end                                                                                                                                                         	|  3.6499e-06     	|  1              	|  3.6499e-06     	|  2.7419e-07     	|
|  [Callback]GradientAccumulationScheduler.teardown                                                                                                                                                           	|  3.6294e-06     	|  1              	|  3.6294e-06     	|  2.7265e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.teardown                           	|  3.6098e-06     	|  1              	|  3.6098e-06     	|  2.7118e-07     	|
|  [Callback]TQDMProgressBar.on_configure_sharded_model                                                                                                                                                       	|  3.5595e-06     	|  1              	|  3.5595e-06     	|  2.674e-07      	|
|  [Callback]TQDMProgressBar.on_before_accelerator_backend_setup                                                                                                                                              	|  3.4701e-06     	|  1              	|  3.4701e-06     	|  2.6068e-07     	|
|  [Callback]GradientAccumulationScheduler.setup                                                                                                                                                              	|  3.4608e-06     	|  1              	|  3.4608e-06     	|  2.5998e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_fit_end                         	|  3.4496e-06     	|  1              	|  3.4496e-06     	|  2.5914e-07     	|
|  [LightningModule]NeRFSystem.prepare_data                                                                                                                                                                   	|  3.3602e-06     	|  1              	|  3.3602e-06     	|  2.5243e-07     	|
|  [LightningModule]NeRFSystem.on_fit_start                                                                                                                                                                   	|  3.2494e-06     	|  1              	|  3.2494e-06     	|  2.441e-07      	|
|  [LightningModule]NeRFSystem.on_validation_end                                                                                                                                                              	|  1.5353e-06     	|  2              	|  3.0706e-06     	|  2.3067e-07     	|
|  [Callback]GradientAccumulationScheduler.on_pretrain_routine_start                                                                                                                                          	|  3.01e-06       	|  1              	|  3.01e-06       	|  2.2612e-07     	|
|  [Callback]TQDMProgressBar.on_pretrain_routine_end                                                                                                                                                          	|  2.8899e-06     	|  1              	|  2.8899e-06     	|  2.171e-07      	|
|  [Callback]GradientAccumulationScheduler.on_before_accelerator_backend_setup                                                                                                                                	|  2.8498e-06     	|  1              	|  2.8498e-06     	|  2.1409e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_accelerator_backend_setup	|  2.8498e-06     	|  1              	|  2.8498e-06     	|  2.1409e-07     	|
|  [Callback]GradientAccumulationScheduler.on_pretrain_routine_end                                                                                                                                            	|  2.7698e-06     	|  1              	|  2.7698e-06     	|  2.0807e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_pretrain_routine_start          	|  2.7604e-06     	|  1              	|  2.7604e-06     	|  2.0737e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_fit_start                       	|  2.6394e-06     	|  1              	|  2.6394e-06     	|  1.9828e-07     	|
|  [LightningModule]NeRFSystem.configure_sharded_model                                                                                                                                                        	|  2.5397e-06     	|  1              	|  2.5397e-06     	|  1.9079e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_pretrain_routine_end            	|  2.4699e-06     	|  1              	|  2.4699e-06     	|  1.8554e-07     	|
|  [LightningModule]NeRFSystem.on_fit_end                                                                                                                                                                     	|  2.4401e-06     	|  1              	|  2.4401e-06     	|  1.833e-07      	|
|  [LightningModule]NeRFSystem.on_pretrain_routine_start                                                                                                                                                      	|  2.2696e-06     	|  1              	|  2.2696e-06     	|  1.705e-07      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_end                       	|  2.2203e-06     	|  1              	|  2.2203e-06     	|  1.6679e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_configure_sharded_model         	|  2.1206e-06     	|  1              	|  2.1206e-06     	|  1.5931e-07     	|
|  [Callback]GradientAccumulationScheduler.on_configure_sharded_model                                                                                                                                         	|  2.0796e-06     	|  1              	|  2.0796e-06     	|  1.5623e-07     	|
|  [LightningModule]NeRFSystem.teardown                                                                                                                                                                       	|  2.0294e-06     	|  1              	|  2.0294e-06     	|  1.5245e-07     	|
|  [LightningModule]NeRFSystem.on_train_start                                                                                                                                                                 	|  1.7304e-06     	|  1              	|  1.7304e-06     	|  1.2999e-07     	|
|  [LightningModule]NeRFSystem.on_save_checkpoint                                                                                                                                                             	|  1.7304e-06     	|  1              	|  1.7304e-06     	|  1.2999e-07     	|
|  [LightningModule]NeRFSystem.on_train_end                                                                                                                                                                   	|  1.4706e-06     	|  1              	|  1.4706e-06     	|  1.1047e-07     	|
|  [Strategy]SingleDeviceStrategy.on_train_start                                                                                                                                                              	|  1.4296e-06     	|  1              	|  1.4296e-06     	|  1.0739e-07     	|
|  [LightningModule]NeRFSystem.on_pretrain_routine_end                                                                                                                                                        	|  1.2498e-06     	|  1              	|  1.2498e-06     	|  9.3891e-08     	|
|  [Strategy]SingleDeviceStrategy.on_train_end                                                                                                                                                                	|  9.9e-07        	|  1              	|  9.9e-07        	|  7.4371e-08     	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
